-- Logs begin at Wed 2021-11-24 15:24:20 UTC, end at Wed 2021-11-24 16:30:07 UTC. -- Nov 24 15:56:53.085692 dv-cinder-818994-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 24 15:56:53.095621 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 24 15:56:53.097476 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 24 15:56:53 2021] *** Nov 24 15:56:53.097476 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 24 15:56:53.097476 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 24 15:56:53.097476 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: nodename: dv-cinder-818994-2-iscsi Nov 24 15:56:53.097476 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: machine: x86_64 Nov 24 15:56:53.097476 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: clock source: unix Nov 24 15:56:53.097476 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: pcre jit disabled Nov 24 15:56:53.097476 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: detected number of CPU cores: 4 Nov 24 15:56:53.097476 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: current working directory: / Nov 24 15:56:53.097476 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: detected binary path: /usr/bin/uwsgi-core Nov 24 15:56:53.097476 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: your processes number limit is 47680 Nov 24 15:56:53.097476 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: your memory page size is 4096 bytes Nov 24 15:56:53.097476 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: detected max file descriptor number: 2048 Nov 24 15:56:53.098970 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: lock engine: pthread robust mutexes Nov 24 15:56:53.098970 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: thunder lock: enabled Nov 24 15:56:53.098970 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 24 15:56:53.098970 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 24 15:56:53.146017 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: Python main interpreter initialized at 0x565309e5a9c0 Nov 24 15:56:53.146017 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: python threads support enabled Nov 24 15:56:53.146017 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: your server socket listen backlog is limited to 100 connections Nov 24 15:56:53.146017 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: your mercy for graceful operations on workers is 90 seconds Nov 24 15:56:53.146562 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: mapped 403077 bytes (393 KB) for 2 cores Nov 24 15:56:53.146694 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: *** Operational MODE: preforking *** Nov 24 15:56:53.147032 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: *** uWSGI is running in multiple interpreter mode *** Nov 24 15:56:53.147032 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: spawned uWSGI master process (pid: 102094) Nov 24 15:56:53.147302 dv-cinder-818994-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 24 15:56:53.149999 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: spawned uWSGI worker 1 (pid: 102095, cores: 1) Nov 24 15:56:53.149999 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: spawned uWSGI worker 2 (pid: 102096, cores: 1) Nov 24 15:56:53.149999 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 24 15:56:54.822822 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 15:56:54.822822 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: from cryptography.utils import int_from_bytes Nov 24 15:56:54.823538 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 15:56:54.823538 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: from cryptography.utils import int_from_bytes Nov 24 15:56:54.830614 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 15:56:54.830614 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: from cryptography.utils import int_from_bytes Nov 24 15:56:54.831119 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 15:56:54.831119 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: from cryptography.utils import int_from_bytes Nov 24 15:56:57.416161 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 15:56:57.416722 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 15:56:57.416918 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 15:56:57.417306 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 15:56:57.417570 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 15:56:57.417967 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.418302 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.418627 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.418955 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.419261 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 15:56:57.419684 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.419770 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 15:56:57.419861 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.419958 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.420038 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 15:56:57.420241 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.420348 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 15:56:57.420577 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.420665 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 15:56:57.420843 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.420965 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.421195 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.421319 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.421531 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818994-2-iscsi {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.421642 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.421865 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.421960 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.422183 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.422276 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.422504 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.422597 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.422834 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.422934 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.423146 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.423235 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.423478 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.423579 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.423743 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.423837 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.424061 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.424282 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.424386 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818994-2-iscsi {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.424699 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.424823 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.425004 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.425158 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.425333 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.425446 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.425650 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.425772 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.425956 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.426085 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.426278 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.426365 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.426584 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.426675 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.426915 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.427234 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.427337 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.427563 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.427696 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.427863 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.428041 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818994-2-iscsi {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.428169 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.428377 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.428495 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.428695 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.428807 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.429016 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.429207 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.429454 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.429615 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.429792 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.429887 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.430117 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.430250 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.430429 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.430517 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.430767 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.430931 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818994-2-iscsi {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.431075 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.431252 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.431407 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.431565 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.431738 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.431879 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.432066 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.432295 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.432395 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.432609 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.432696 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.432921 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.433013 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.433275 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.433380 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.433602 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.433733 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.433910 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.434005 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.434233 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.434325 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.434489 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.434583 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.434807 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.434900 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.435140 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.435234 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.435461 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.435558 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.435773 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.435860 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.436032 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.436159 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.436289 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.436383 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.436615 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.436714 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.436944 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.437103 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.437285 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.437376 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.437597 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.437693 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.437908 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.438003 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.438224 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.438317 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.438537 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.438632 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.438785 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.438878 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.439035 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.439150 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.439355 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.439465 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.439679 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.439796 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.439990 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.440243 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.440342 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.440598 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.440687 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.440906 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.440996 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.441248 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.441341 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.441531 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.441838 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.441929 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.442145 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.442251 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.442464 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.442552 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.442779 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.442865 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.443103 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.443272 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.443413 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.443506 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.443733 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.443820 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.444067 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.444162 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.444367 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.444453 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.444677 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.444771 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.444991 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.445130 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.445880 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.445997 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.446220 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.446311 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.446534 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.446670 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.446790 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.447001 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.447088 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.447315 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.447411 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.447624 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.447717 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.447936 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.448030 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.448262 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.448360 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.448600 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.448686 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.448907 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.448992 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.449205 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.449311 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.449510 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.449603 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.449819 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.449933 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.450141 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.450231 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.450449 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.450534 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.450756 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.450850 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.451062 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.451156 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.451364 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.451451 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.451671 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.451764 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.451975 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.452075 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.452282 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.452369 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.452587 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.452673 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.452894 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.452988 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.453226 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.453416 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.453540 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.453735 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.453875 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.454044 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.454167 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.454351 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.454479 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.454674 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.454805 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.455025 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.455127 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.455307 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.455395 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.455617 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.455705 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.455925 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.456030 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.456232 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.456330 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.456625 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.456728 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.456932 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.457050 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.457265 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.457350 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.457587 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.457674 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.457891 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.458013 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.458197 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.458287 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.458505 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.458591 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.458810 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.458895 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.459115 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.459200 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.459426 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.459518 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.459724 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.459810 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.460031 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.460127 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.460333 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.460420 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.460644 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.460772 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.461545 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.461698 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.461855 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.462002 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.462167 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.462254 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.462470 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.462570 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.462775 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.462863 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.463080 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.463177 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.463381 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.463477 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.463684 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.463777 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.464001 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.464088 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.464324 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.464419 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.464631 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.464727 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.464937 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.465078 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.465265 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.465380 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.465583 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:56:57.465702 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.465921 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.466037 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.466253 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.466348 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.466597 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.466684 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.466911 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.466998 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.467246 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.467341 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.467574 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.467660 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.467888 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.467981 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.468199 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.468286 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.468512 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.468606 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.468833 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.468927 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.469163 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.469252 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.469475 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.469574 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.469784 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.469878 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.470101 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.470189 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.470418 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.470507 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.470754 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.470854 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.471069 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.471156 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.471382 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.471469 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.471700 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.471795 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.472009 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.472104 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.472325 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.472442 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.472642 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.472745 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.472960 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.473134 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.473297 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.473392 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.473629 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.473724 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.473948 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.474079 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.474264 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.474349 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.474593 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.474690 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.474903 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.474991 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.475222 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.475306 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.475535 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.475622 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.475842 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.475928 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.476148 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.476241 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.477006 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.477152 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.477425 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.477511 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.477761 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.477846 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.478103 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.478190 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.478424 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.478510 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.478743 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.478838 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.479053 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.479147 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.479363 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.479459 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.479671 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.479767 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.479982 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.480076 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.480290 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.480375 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.480616 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.480712 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.480935 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.481053 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.481267 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.481378 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.481606 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.481707 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.481916 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.482010 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.482228 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.482315 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.482538 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.482627 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.482846 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.482935 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.483158 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.483245 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.483471 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.483564 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.483776 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.483863 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.484094 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.484179 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.484404 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.484491 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.484711 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.484803 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.485105 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.485248 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.485352 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.485434 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.485655 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.485750 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.485970 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.486067 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.486285 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.486421 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.486593 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.486689 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.486905 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.487006 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.487230 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.487332 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.487544 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.487648 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.487853 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.487950 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.488169 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.488256 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.488487 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.488581 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.488798 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.488937 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.489131 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.489222 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.489447 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.489547 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.489761 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.489863 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.490061 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.490156 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.490369 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.490459 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.490680 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.490794 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.490980 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.491074 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.491286 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.491387 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.491592 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.491687 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.491892 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.491978 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.492272 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.492365 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.492584 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.492680 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.492961 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.493118 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.493306 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.493405 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.493635 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.493722 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.493948 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.494041 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.494257 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.494352 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.494565 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.494652 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.494868 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.494955 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.495242 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.495414 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.495559 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.495647 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.495875 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.495962 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.496203 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.496339 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.496523 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.496643 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.496850 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.496945 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.497196 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.497296 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.497528 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.497617 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.497846 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.497933 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.498173 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.498263 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.498486 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.498618 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.498791 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.498877 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.499114 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.499202 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.499663 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.500038 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.500124 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.500204 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.500292 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.500369 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.500624 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.500712 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.500933 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.501022 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.501280 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.501370 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.501587 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.501675 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.501901 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.501997 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.502219 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.502307 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.502543 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.502630 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.502862 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.502958 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.503183 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.503268 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.503498 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.503679 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.503790 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.503887 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.504100 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.504193 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.504413 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.504500 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.504725 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.504822 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.505050 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.505143 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.505372 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.505471 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.505683 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.505778 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.506001 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.506089 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.506309 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.506397 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.506638 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.506738 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.506942 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.507032 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.507256 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.507355 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.507559 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.507655 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.508420 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.508578 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.508725 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.508804 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.509055 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.509148 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.509377 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.509464 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.509688 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.509787 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.510002 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.510095 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.510309 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.510396 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.510626 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.510730 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.510935 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.511030 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.511240 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.511328 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.511547 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.511645 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.511934 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.512023 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.512267 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.512345 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.512576 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.512664 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.512889 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.512978 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.513220 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.513310 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.513536 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.513640 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.513845 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.513930 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.514145 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.514233 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.514450 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.514546 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.514762 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.514850 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.515076 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.515162 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.515387 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.515474 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.515711 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.515797 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.516034 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.516128 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.516340 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.516428 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.516646 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.516733 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.516969 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.517133 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.517302 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.517391 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.517604 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.517691 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.517908 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.518004 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.518211 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.518298 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.524579 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.524759 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.524759 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.525019 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.525273 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.525415 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.525561 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.525706 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.525805 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.525911 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.526051 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.526139 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.526208 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.526273 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.526339 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.526416 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.526485 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.526558 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.526626 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.526722 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.526864 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.526952 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.527020 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.527086 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.527152 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.527217 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.527292 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.527374 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.527463 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.527463 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.527607 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.527675 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.527749 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.527816 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.527881 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.527953 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.528027 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.528093 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.528093 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.528230 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.528304 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.528304 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.528427 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.528579 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.528669 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.528750 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.528750 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.528876 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.528941 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.528941 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.529143 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.529213 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.529279 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.529344 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.529344 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.529475 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.529548 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.529548 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.529677 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.529749 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.529749 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.529874 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.529983 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.530297 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.530391 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.530609 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.530793 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.530917 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.531224 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.531311 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.531534 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.531690 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.531839 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.532139 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.532228 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.532472 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.532557 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.532780 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.533010 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.533130 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.533415 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.533509 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.533728 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.533949 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.534045 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.534343 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.534438 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.534653 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.534917 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.535016 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.535246 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.535389 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.535551 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.535924 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.536026 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.536255 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.536361 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.536513 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.536737 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.536834 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.537196 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.537285 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.537505 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.537748 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.537850 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.538125 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.538220 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.538432 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.538667 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.538765 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.539051 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.539180 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.539394 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.539738 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.539971 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.540073 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.540333 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.540455 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.540649 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.540959 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.541111 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.541293 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.541516 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.541605 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.541891 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.541976 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.542229 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.542526 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.542634 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.542806 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.542988 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.543108 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.543413 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.543508 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.543720 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.543868 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.544026 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.544323 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.544459 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.544629 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.544861 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.544994 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.545255 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.545369 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.545561 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.545831 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.545920 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.546153 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.546292 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.546523 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.546744 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.546833 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.547126 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.547211 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.547453 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.547609 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.547763 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.548062 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.548149 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.548363 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.548518 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.548672 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.548973 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.549082 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.549298 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.549519 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.549607 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.549920 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.550059 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.550235 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.550432 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.550545 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.550854 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.550950 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.551158 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.551498 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.551603 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.551753 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.551850 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.552062 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.552247 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.552365 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.552669 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.552769 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.552973 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.553175 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.553298 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.553601 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.553695 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.553924 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.554046 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.554234 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.554515 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.554686 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.554922 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.555229 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.555487 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.555580 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.555871 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.555970 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.556236 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.556398 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.556539 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.556831 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.556919 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.557186 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.557313 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.557496 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.557774 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.557871 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.558107 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.558221 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.558412 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.558683 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.558771 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.559023 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.559109 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.559337 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.559585 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.559686 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.559932 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.560065 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.560254 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.560499 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.560597 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.560868 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.560955 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.561215 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.561472 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.561573 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.561849 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.561946 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.562154 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.562362 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.562451 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.562760 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.562855 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.563068 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.563233 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.563376 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.563683 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.563770 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.563992 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.564147 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.564301 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.564599 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.564694 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.564908 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.565157 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.565329 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.565552 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.565715 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.565862 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.566166 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.566255 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.566468 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.566649 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.566796 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.567101 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.567201 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.567405 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.567561 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.567712 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.568009 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.568096 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.568318 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.568462 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.568623 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.568959 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.569100 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.569386 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.569474 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.569701 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.569969 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.570149 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.570923 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.571026 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.571374 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.571518 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.571685 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.571936 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.572033 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.572298 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.572394 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.572717 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.572804 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.573052 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.573278 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.573384 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.573664 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.573751 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.573971 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.574162 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.574262 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.574573 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.574660 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.574900 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.575107 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.575211 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.575495 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.575606 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.575797 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.575978 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.576118 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.576426 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.576570 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.576744 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.576917 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.577179 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.577409 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.577520 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.577782 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.577878 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.578199 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.578288 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.578511 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.578737 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.578833 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.579129 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.579222 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.579455 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.579598 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.579778 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.580082 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.580171 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.580399 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.580537 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.580714 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.580996 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.581133 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.581373 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.581458 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.581685 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.581966 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.582067 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.582291 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.582425 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.582644 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.582991 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.583169 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.583310 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.583510 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.583605 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.583970 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.584058 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.584295 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.584441 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.584607 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.584900 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.584995 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.585270 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.585464 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.585632 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.585946 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.586578 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.586758 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.587060 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.587266 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.587355 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.587676 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.587764 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.587982 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.588150 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.588294 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.588602 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.588689 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.588908 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.589085 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.589250 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.589545 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.589633 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.589869 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.590073 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.590163 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.590484 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.590677 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.590799 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.591119 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.591206 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.591439 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.591574 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.591745 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.592045 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.592132 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.592361 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.592521 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.592663 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.592965 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.593114 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.593296 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.593484 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.593639 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.593942 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.594029 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.594259 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.594396 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.594590 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.594919 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.595006 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.595227 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.595477 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.595577 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.595875 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.595987 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.596189 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.596352 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.596506 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.597698 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.597822 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.597822 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.597982 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.598066 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.598149 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.598217 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.598217 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.598350 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.598427 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.598594 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.598681 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.598900 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.599052 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.599200 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.599502 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.599596 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.599803 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.599987 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.600124 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.600419 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.600514 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.600745 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.600898 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.601071 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.601380 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.601561 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.601730 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.602036 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.602228 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.602541 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.602631 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.602852 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.603189 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.603277 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.603514 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.603654 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.603841 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.604106 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.604194 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.604469 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.604555 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.604798 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.605021 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.605137 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.605446 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.605581 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.605763 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.606056 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.606146 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.606380 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.606525 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.606698 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.606987 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.607086 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.607311 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.607460 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.607686 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.607925 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.608013 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.608312 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.608470 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.608785 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.608873 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.609238 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.609328 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.609560 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.609724 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.609877 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.610195 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.610290 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.610511 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.610712 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.610833 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.611150 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.611238 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.611465 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.611745 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.611841 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.612079 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.612291 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.612411 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.612733 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.612821 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.613078 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.613257 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.613424 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.613718 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.613806 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.614052 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.614153 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.614371 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.614599 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.614687 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.615023 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.615119 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.615342 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.615469 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.615654 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.615948 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.616084 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.616275 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.616476 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.616594 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.616905 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.616993 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.617910 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.618100 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.618317 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.618545 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.618639 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.618859 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.618958 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.619250 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.619338 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.619569 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.619725 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.619888 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.620197 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.620287 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.620551 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.620726 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.620877 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.621222 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.621318 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.621547 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.621790 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.621886 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.622294 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.622426 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.622746 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.622832 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.623130 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.623218 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.623472 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.623802 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.624127 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.624447 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.625050 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.625446 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.625761 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.626073 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.626385 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.626692 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.627016 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.627332 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.627642 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.627962 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.628271 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.628823 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.629206 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.629528 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.629857 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.630184 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.630505 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.630814 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.631138 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.631452 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.631760 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.632078 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.632393 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.632725 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.632906 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.633386 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.633558 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.633705 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.633705 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.633955 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.634098 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.634240 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.634399 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.634542 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.634753 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.634919 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.635164 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.635319 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.635459 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.635742 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.635942 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.636082 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.636321 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.636538 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.636673 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.636860 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.636999 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.637254 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.637401 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.637563 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.637860 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.638050 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.638217 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.638408 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.638562 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.638757 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.638936 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.639058 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.639361 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.639505 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.639663 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.640489 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.640633 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.640791 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.641124 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.641218 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.641462 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.641752 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.641844 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.642081 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.642313 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.642418 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.642696 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.642886 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.643053 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.643374 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.643469 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.643966 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.644063 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.644359 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.644582 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.644671 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.645019 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.645207 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.645386 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.645704 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.645863 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.646021 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.646296 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.646414 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.646609 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.646870 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.646971 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.647218 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.647474 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.647632 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.647826 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.648050 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.648189 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.648459 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.648769 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.648936 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.649150 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.649397 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.649696 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.649845 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.650049 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.650280 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.650423 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.650675 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.650864 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.651010 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.651291 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.651435 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.651608 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.651918 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.652071 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.652210 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.652524 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.652726 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.652870 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.653179 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.653331 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.653491 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.653796 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.653944 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.654229 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.654416 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.654565 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.654849 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.655011 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.655159 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.655464 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.655616 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.655775 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.656098 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.656308 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.656451 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.656718 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.656869 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.657112 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.657346 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.657499 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.657699 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.657934 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.658097 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.658343 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.658492 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.658633 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.658942 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.659106 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.659260 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.659534 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.659676 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.659858 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.660195 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.660346 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.660491 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.660783 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.660928 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.661151 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.661414 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.661570 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.661737 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.661998 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.662154 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.662362 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.662557 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.662726 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.662976 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.663307 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.663570 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.663727 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.663913 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.664258 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.664571 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.664869 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.665279 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.665279 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.665545 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.665681 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.665847 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.666017 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.666158 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.666435 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.666606 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.666768 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.667059 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.667214 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.667360 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.667668 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.667835 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.668114 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.668279 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.668436 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.668733 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.668886 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.669073 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.669369 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.669540 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.669717 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.669986 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.670140 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.670302 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.670593 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.670747 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.670933 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.671192 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.671341 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.671596 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.671797 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.671964 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.672241 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.672418 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.672565 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.672869 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.673072 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.673219 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.673506 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.673673 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.673834 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 15:56:57.674164 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.674746 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.675406 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.675990 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.676558 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.677163 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.677755 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.678345 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.678918 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.679492 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.680623 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.681246 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.681825 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.682399 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.682984 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.683564 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.684164 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.684764 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.685374 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.685957 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.686547 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.687134 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.688125 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.688702 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.689392 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.689995 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.690594 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.691172 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.691768 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.692794 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.693377 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.693928 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.694508 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.695092 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.696348 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.696947 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.697566 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.698140 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.698582 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG oslo_db.sqlalchemy.engines [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102095) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:56:57.698727 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.699307 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.700338 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.700984 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.701606 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.702223 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.702809 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.703391 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.703974 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.704545 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.705127 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.705676 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.706255 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.706824 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.707375 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.707931 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.708502 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.709097 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.709662 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.710238 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.710876 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.712519 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.712805 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.717361 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.717361 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.717361 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.717361 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.717361 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.717361 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.717361 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.717361 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.718082 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.718389 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.718964 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.719535 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.720120 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.720679 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.721303 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.721948 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.722524 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.723075 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.723672 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.724240 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.724839 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.725445 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.726033 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.726895 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.727489 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.728509 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.729220 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.729803 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.730457 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.731088 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.731661 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.732231 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.732798 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.733426 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.733996 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.734595 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.735164 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.735739 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.736327 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.736892 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.737519 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.738092 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.738654 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.739257 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.739880 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.740459 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.741099 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.741708 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.743084 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.743668 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.744238 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.744831 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.745429 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.746006 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.746646 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.747232 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.747795 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.748610 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.749216 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.750081 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.750620 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.751114 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.751658 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.752227 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.752786 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.753407 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.753996 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.754597 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.755232 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.755856 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.756455 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.757071 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.757635 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.758886 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.759456 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.760085 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.760692 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.761320 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.761869 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.762395 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.762927 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.763440 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.763971 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.764494 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.765011 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.765539 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.766078 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.766581 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.767091 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.767602 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.768181 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.768583 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.769099 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.769631 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.770124 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.770298 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.context [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e04849b7-0f13-4ee3-8a70-886919bfc8c5(cell1) {{(pid=102095) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 15:56:57.770595 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.771118 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.771654 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.772216 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.772745 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.773334 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.773941 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.774613 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.774803 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG oslo_concurrency.lockutils [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:56:57.774984 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.775317 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.775835 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.776244 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.776522 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG oslo_concurrency.lockutils [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:56:57.776787 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.777413 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.777509 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG oslo_concurrency.lockutils [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:56:57.777954 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.778527 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.779098 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.779527 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG oslo_concurrency.lockutils [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102095) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:56:57.779744 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.780258 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.780758 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.781412 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.781854 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.782194 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.782582 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:56:57.782841 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 15:56:57.791546 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG oslo_db.sqlalchemy.engines [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102095) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:56:57.793105 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG oslo_db.sqlalchemy.engines [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102095) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:56:57.819646 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_db.sqlalchemy.engines [None req-6801d2a3-0f0d-4349-99bb-bd1cf778a592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:56:57.896531 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.context [None req-6801d2a3-0f0d-4349-99bb-bd1cf778a592 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e04849b7-0f13-4ee3-8a70-886919bfc8c5(cell1) {{(pid=102096) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 15:56:57.902319 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-6801d2a3-0f0d-4349-99bb-bd1cf778a592 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:56:57.904102 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-6801d2a3-0f0d-4349-99bb-bd1cf778a592 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:56:57.905093 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-6801d2a3-0f0d-4349-99bb-bd1cf778a592 None None] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:56:57.907223 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-6801d2a3-0f0d-4349-99bb-bd1cf778a592 None None] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:56:57.923556 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_db.sqlalchemy.engines [None req-6801d2a3-0f0d-4349-99bb-bd1cf778a592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:56:57.926350 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_db.sqlalchemy.engines [None req-6801d2a3-0f0d-4349-99bb-bd1cf778a592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:56:58.060790 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG oslo_db.sqlalchemy.engines [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102095) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:56:58.193907 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_db.sqlalchemy.engines [None req-6801d2a3-0f0d-4349-99bb-bd1cf778a592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:56:58.415719 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: WARNING keystonemiddleware.auth_token [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 15:56:58.422461 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: WARNING keystonemiddleware.auth_token [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 15:56:58.542493 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: WARNING keystonemiddleware.auth_token [None req-6801d2a3-0f0d-4349-99bb-bd1cf778a592 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 15:56:58.550341 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: WARNING keystonemiddleware.auth_token [None req-6801d2a3-0f0d-4349-99bb-bd1cf778a592 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 15:56:58.653000 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: WARNING keystonemiddleware.auth_token [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 15:56:58.658231 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: WARNING keystonemiddleware.auth_token [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 15:56:58.663752 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x565309e5a9c0 pid: 102095 (default app) Nov 24 15:56:58.666092 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:56:58.667231 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] 10.222.0.72 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001889 Nov 24 15:56:58.667639 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 788 bytes} [Wed Nov 24 15:56:58 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:56:58.783620 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: WARNING keystonemiddleware.auth_token [None req-6801d2a3-0f0d-4349-99bb-bd1cf778a592 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 15:56:58.791134 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: WARNING keystonemiddleware.auth_token [None req-6801d2a3-0f0d-4349-99bb-bd1cf778a592 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 15:56:58.796894 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x565309e5a9c0 pid: 102096 (default app) Nov 24 15:58:23.727804 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:58:23.729618 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Nov 24 15:58:23.730032 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 2/2] 10.222.0.72 () {54 vars in 930 bytes} [Wed Nov 24 15:58:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:58:24.305964 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-245dfc03-07e1-48a4-9b63-fb9f085708d5 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:58:24.340120 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-245dfc03-07e1-48a4-9b63-fb9f085708d5 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.602374 Nov 24 15:58:24.340984 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 1/3] 10.222.0.72 () {60 vars in 1291 bytes} [Wed Nov 24 15:58:23 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:58:26.797802 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:58:26.798735 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-2de251dc-c0d6-44ee-93c0-8454f778bdd2 None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Nov 24 15:58:26.799150 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 3/4] 10.222.0.72 () {54 vars in 930 bytes} [Wed Nov 24 15:58:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:58:26.864950 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-710a4cd1-1d73-47fd-84b8-20f9f7c8e057 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0}} {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:26.884510 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:58:26.884510 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: warnings.warn(msg) Nov 24 15:58:26.916136 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-710a4cd1-1d73-47fd-84b8-20f9f7c8e057 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109805 Nov 24 15:58:26.921228 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 2/5] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Nov 24 15:58:26 2021] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:58:27.278285 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-3b7a771a-3ceb-431c-9662-9eec838d4352 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:27.280637 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:58:27.280637 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: warnings.warn(msg) Nov 24 15:58:27.363480 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-3b7a771a-3ceb-431c-9662-9eec838d4352 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.437020 Nov 24 15:58:27.364624 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 4/6] 10.222.0.72 () {64 vars in 1335 bytes} [Wed Nov 24 15:58:26 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:58:29.776164 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-710a4cd1-1d73-47fd-84b8-20f9f7c8e057 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:58:29.777290 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-710a4cd1-1d73-47fd-84b8-20f9f7c8e057 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Nov 24 15:58:29.777884 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 3/7] 10.222.0.72 () {54 vars in 930 bytes} [Wed Nov 24 15:58:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:58:29.898298 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-7b5aafbb-8e3c-4792-a552-e3b2f1f19e69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "disk": 5}} {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:29.917803 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:58:29.917803 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: warnings.warn(msg) Nov 24 15:58:29.942281 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-7b5aafbb-8e3c-4792-a552-e3b2f1f19e69 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156637 Nov 24 15:58:29.950242 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 5/8] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Nov 24 15:58:29 2021] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:58:29.955829 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-022416da-66c4-42a8-b4ff-6c759cf54177 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:29.957892 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:58:29.957892 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: warnings.warn(msg) Nov 24 15:58:30.005785 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-022416da-66c4-42a8-b4ff-6c759cf54177 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053670 Nov 24 15:58:30.006989 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 4/9] 10.222.0.72 () {64 vars in 1335 bytes} [Wed Nov 24 15:58:29 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:58:32.393553 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-7b5aafbb-8e3c-4792-a552-e3b2f1f19e69 admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:58:32.394754 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-7b5aafbb-8e3c-4792-a552-e3b2f1f19e69 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Nov 24 15:58:32.395396 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 6/10] 10.222.0.72 () {54 vars in 930 bytes} [Wed Nov 24 15:58:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:58:32.462997 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-60dfaf0f-50b5-438f-866d-069d43880a10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 10, "ram": 1024, "id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:32.484793 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-60dfaf0f-50b5-438f-866d-069d43880a10 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082770 Nov 24 15:58:32.485419 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 5/11] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Nov 24 15:58:32 2021] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:58:32.499231 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-e293c61c-bb99-4eee-aa07-a8f293f0156b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:32.524630 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-e293c61c-bb99-4eee-aa07-a8f293f0156b admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029642 Nov 24 15:58:32.530908 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 7/12] 10.222.0.72 () {64 vars in 1335 bytes} [Wed Nov 24 15:58:32 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:58:34.882619 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-60dfaf0f-50b5-438f-866d-069d43880a10 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:58:34.883634 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-60dfaf0f-50b5-438f-866d-069d43880a10 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Nov 24 15:58:34.884050 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 6/13] 10.222.0.72 () {54 vars in 930 bytes} [Wed Nov 24 15:58:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:58:34.945148 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-1e11fd9c-d056-4864-a91f-541ab5517507 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "ram": 2048, "id": "d3", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:34.964777 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-1e11fd9c-d056-4864-a91f-541ab5517507 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074263 Nov 24 15:58:34.965405 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 8/14] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Nov 24 15:58:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:58:34.978419 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-207e1aea-9dd9-4a04-966c-c561fc0b781d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:35.005177 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-207e1aea-9dd9-4a04-966c-c561fc0b781d admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030509 Nov 24 15:58:35.005860 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 7/15] 10.222.0.72 () {64 vars in 1335 bytes} [Wed Nov 24 15:58:34 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:58:37.352268 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-1e11fd9c-d056-4864-a91f-541ab5517507 admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:58:37.353364 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-1e11fd9c-d056-4864-a91f-541ab5517507 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Nov 24 15:58:37.353766 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 9/16] 10.222.0.72 () {54 vars in 930 bytes} [Wed Nov 24 15:58:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:58:37.415377 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-e8abf122-260f-4d04-80b7-a6e3f91956a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "vcpus": 4, "disk": 20, "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:37.436286 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-e8abf122-260f-4d04-80b7-a6e3f91956a9 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076082 Nov 24 15:58:37.436959 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 8/17] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Nov 24 15:58:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:58:37.450145 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-7ba5fb29-78f6-4ac0-a7ed-e9f37f2614ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:37.478676 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-7ba5fb29-78f6-4ac0-a7ed-e9f37f2614ca admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032354 Nov 24 15:58:37.479554 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 10/18] 10.222.0.72 () {64 vars in 1335 bytes} [Wed Nov 24 15:58:37 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:58:39.934957 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-e8abf122-260f-4d04-80b7-a6e3f91956a9 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:58:39.936282 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-e8abf122-260f-4d04-80b7-a6e3f91956a9 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001752 Nov 24 15:58:39.936851 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 9/19] 10.222.0.72 () {54 vars in 930 bytes} [Wed Nov 24 15:58:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:58:40.001964 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-4874ff37-0c7a-4c08-b851-91a619f033a5 admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:58:40.039359 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-4874ff37-0c7a-4c08-b851-91a619f033a5 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.092833 Nov 24 15:58:40.040065 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 11/20] 10.222.0.72 () {60 vars in 1291 bytes} [Wed Nov 24 15:58:39 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:58:42.649798 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-e8abf122-260f-4d04-80b7-a6e3f91956a9 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:58:42.651299 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-e8abf122-260f-4d04-80b7-a6e3f91956a9 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002107 Nov 24 15:58:42.652031 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 10/21] 10.222.0.72 () {54 vars in 930 bytes} [Wed Nov 24 15:58:42 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:58:42.715891 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-f54b1515-0f96-4548-96d4-97148446cadd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:42.738649 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-f54b1515-0f96-4548-96d4-97148446cadd admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079609 Nov 24 15:58:42.739563 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 12/22] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Nov 24 15:58:42 2021] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:58:42.756827 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-88352046-22d7-4192-a5ea-c46e6e3929dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:42.790611 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-88352046-22d7-4192-a5ea-c46e6e3929dc admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039496 Nov 24 15:58:42.791447 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 11/23] 10.222.0.72 () {64 vars in 1332 bytes} [Wed Nov 24 15:58:42 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:58:45.228720 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-f54b1515-0f96-4548-96d4-97148446cadd admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:58:45.229795 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-f54b1515-0f96-4548-96d4-97148446cadd admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Nov 24 15:58:45.230198 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 13/24] 10.222.0.72 () {54 vars in 930 bytes} [Wed Nov 24 15:58:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:58:45.292576 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-01a0fb9f-131b-486a-b6b7-cf1d40fff5d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20}} {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:45.311431 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-01a0fb9f-131b-486a-b6b7-cf1d40fff5d4 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074798 Nov 24 15:58:45.313196 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 12/25] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Nov 24 15:58:45 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:58:45.325997 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-3291296c-80f6-46a0-ab37-0a4a6c9ff80a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:45.351816 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-3291296c-80f6-46a0-ab37-0a4a6c9ff80a admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029543 Nov 24 15:58:45.352415 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 14/26] 10.222.0.72 () {64 vars in 1332 bytes} [Wed Nov 24 15:58:45 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:58:47.737965 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-01a0fb9f-131b-486a-b6b7-cf1d40fff5d4 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:58:47.738968 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-01a0fb9f-131b-486a-b6b7-cf1d40fff5d4 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Nov 24 15:58:47.739374 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 13/27] 10.222.0.72 () {54 vars in 930 bytes} [Wed Nov 24 15:58:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:58:47.798808 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-3b4e6f9d-83f2-4be7-918c-54999b812246 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "ram": 4096}} {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:47.818327 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-3b4e6f9d-83f2-4be7-918c-54999b812246 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072221 Nov 24 15:58:47.818966 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 15/28] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Nov 24 15:58:47 2021] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:58:47.831873 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-d8603334-32c5-4b94-a1ca-db5ed6e6618b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:47.856337 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-d8603334-32c5-4b94-a1ca-db5ed6e6618b admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028724 Nov 24 15:58:47.857064 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 14/29] 10.222.0.72 () {64 vars in 1332 bytes} [Wed Nov 24 15:58:47 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:58:50.249985 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-3b4e6f9d-83f2-4be7-918c-54999b812246 admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:58:50.251625 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-3b4e6f9d-83f2-4be7-918c-54999b812246 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002390 Nov 24 15:58:50.252025 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 16/30] 10.222.0.72 () {54 vars in 930 bytes} [Wed Nov 24 15:58:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:58:50.317854 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-a1994922-cfd7-410b-b1a1-f106650bfb1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "swap": 0}} {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:50.337356 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-a1994922-cfd7-410b-b1a1-f106650bfb1f admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078907 Nov 24 15:58:50.338193 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 15/31] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Nov 24 15:58:50 2021] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:58:50.351280 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-1792eb77-7d8e-45d7-9b2e-de07467227da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:50.378476 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-1792eb77-7d8e-45d7-9b2e-de07467227da admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031108 Nov 24 15:58:50.379070 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 17/32] 10.222.0.72 () {64 vars in 1332 bytes} [Wed Nov 24 15:58:50 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:58:52.872780 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-a1994922-cfd7-410b-b1a1-f106650bfb1f admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:58:52.873795 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-a1994922-cfd7-410b-b1a1-f106650bfb1f admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Nov 24 15:58:52.874994 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 16/33] 10.222.0.72 () {54 vars in 930 bytes} [Wed Nov 24 15:58:52 2021] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:58:52.939347 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-fcb3a904-d089-4954-aae9-49319f097d0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "swap": 0}} {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:52.961732 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-fcb3a904-d089-4954-aae9-49319f097d0b admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079895 Nov 24 15:58:52.963260 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 18/34] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Nov 24 15:58:52 2021] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:58:52.976207 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-55245721-60a4-4a3e-9fa3-8bab78d81980 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:58:53.002029 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-55245721-60a4-4a3e-9fa3-8bab78d81980 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030308 Nov 24 15:58:53.003548 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 17/35] 10.222.0.72 () {64 vars in 1332 bytes} [Wed Nov 24 15:58:52 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:59:14.861983 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-fcb3a904-d089-4954-aae9-49319f097d0b admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:14.863246 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-fcb3a904-d089-4954-aae9-49319f097d0b admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001697 Nov 24 15:59:14.863690 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 19/36] 10.222.0.72 () {54 vars in 930 bytes} [Wed Nov 24 15:59:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:59:14.923208 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-d217e6ac-10e5-41bb-b6a4-a6a5ee200b2e admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:14.940267 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-d217e6ac-10e5-41bb-b6a4-a6a5ee200b2e admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069476 Nov 24 15:59:14.940823 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 18/37] 10.222.0.72 () {60 vars in 1291 bytes} [Wed Nov 24 15:59:14 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:59:16.469014 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-fcb3a904-d089-4954-aae9-49319f097d0b admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:16.470032 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-fcb3a904-d089-4954-aae9-49319f097d0b admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Nov 24 15:59:16.470431 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 20/38] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Nov 24 15:59:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:59:16.666939 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-8347f353-86a1-4285-9df0-dce0b54a3e8d admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:16.672598 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.wsgi [None req-8347f353-86a1-4285-9df0-dce0b54a3e8d admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 24 15:59:16.673202 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-8347f353-86a1-4285-9df0-dce0b54a3e8d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:59:16.673997 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-8347f353-86a1-4285-9df0-dce0b54a3e8d admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064583 Nov 24 15:59:16.675076 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 19/39] 10.222.0.72 () {60 vars in 1190 bytes} [Wed Nov 24 15:59:16 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 15:59:16.684857 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-a2c8604e-deca-4146-b4fa-8b78196b8820 admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:16.706361 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-a2c8604e-deca-4146-b4fa-8b78196b8820 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024958 Nov 24 15:59:16.706921 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 21/40] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Nov 24 15:59:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:59:16.717304 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-8c174d96-a559-4807-a701-8054592626f3 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:16.739406 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-8c174d96-a559-4807-a701-8054592626f3 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025537 Nov 24 15:59:16.739919 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 20/41] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Nov 24 15:59:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:59:16.750274 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-218ac26c-990e-492e-a8ee-1505725667a1 admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:16.756193 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.wsgi [None req-218ac26c-990e-492e-a8ee-1505725667a1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 24 15:59:16.756769 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-218ac26c-990e-492e-a8ee-1505725667a1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:59:16.757614 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-218ac26c-990e-492e-a8ee-1505725667a1 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011256 Nov 24 15:59:16.758147 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 22/42] 10.222.0.72 () {60 vars in 1190 bytes} [Wed Nov 24 15:59:16 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 15:59:18.173407 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-8c174d96-a559-4807-a701-8054592626f3 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:18.174533 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-8c174d96-a559-4807-a701-8054592626f3 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Nov 24 15:59:18.175260 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 21/43] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Nov 24 15:59:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:59:18.389804 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-6412a67a-b3eb-4ba5-aed9-b1dd6947d578 admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:18.395745 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.wsgi [None req-6412a67a-b3eb-4ba5-aed9-b1dd6947d578 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 24 15:59:18.396298 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-6412a67a-b3eb-4ba5-aed9-b1dd6947d578 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:59:18.397107 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-6412a67a-b3eb-4ba5-aed9-b1dd6947d578 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059545 Nov 24 15:59:18.397631 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 23/44] 10.222.0.72 () {60 vars in 1190 bytes} [Wed Nov 24 15:59:18 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 15:59:18.407391 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-4147e0fb-4982-4b37-b1f6-617823e7559b admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:18.420823 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-4147e0fb-4982-4b37-b1f6-617823e7559b admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016909 Nov 24 15:59:18.421435 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 22/45] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Nov 24 15:59:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:59:18.431550 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-95f39a58-7e24-4d9e-8c69-d6fd8ad116dc admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:18.445668 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-95f39a58-7e24-4d9e-8c69-d6fd8ad116dc admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017634 Nov 24 15:59:18.446206 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 24/46] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Nov 24 15:59:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:59:18.457125 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-c698bb70-1350-45d6-bed9-4abb5fb3fb07 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:18.462630 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.wsgi [None req-c698bb70-1350-45d6-bed9-4abb5fb3fb07 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 24 15:59:18.463200 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-c698bb70-1350-45d6-bed9-4abb5fb3fb07 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:59:18.464006 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-c698bb70-1350-45d6-bed9-4abb5fb3fb07 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011048 Nov 24 15:59:18.464519 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 23/47] 10.222.0.72 () {60 vars in 1190 bytes} [Wed Nov 24 15:59:18 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 24 15:59:19.861146 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-95f39a58-7e24-4d9e-8c69-d6fd8ad116dc admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:19.862940 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-95f39a58-7e24-4d9e-8c69-d6fd8ad116dc admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Nov 24 15:59:19.863522 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 25/48] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Nov 24 15:59:19 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:59:20.056114 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-5aa9f332-0c0a-4341-ade8-8d4f52690dc9 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:20.061450 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.wsgi [None req-5aa9f332-0c0a-4341-ade8-8d4f52690dc9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 24 15:59:20.062003 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-5aa9f332-0c0a-4341-ade8-8d4f52690dc9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:59:20.062790 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-5aa9f332-0c0a-4341-ade8-8d4f52690dc9 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058505 Nov 24 15:59:20.063306 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 24/49] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Nov 24 15:59:20 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 15:59:20.074504 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-6e67f313-7a75-4071-9735-a4a8d3251721 admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:20.088786 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-6e67f313-7a75-4071-9735-a4a8d3251721 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017823 Nov 24 15:59:20.089358 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 26/50] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Nov 24 15:59:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:59:20.101197 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-015ec63d-fce9-425b-9f9e-fe6c11714912 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:20.114605 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-015ec63d-fce9-425b-9f9e-fe6c11714912 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018723 Nov 24 15:59:20.115151 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 25/51] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Nov 24 15:59:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:59:20.125293 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-d3f90c08-4867-4bd2-948b-d49e71b21de1 admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:20.131099 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.wsgi [None req-d3f90c08-4867-4bd2-948b-d49e71b21de1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 24 15:59:20.131665 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-d3f90c08-4867-4bd2-948b-d49e71b21de1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102095) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:59:20.132457 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-d3f90c08-4867-4bd2-948b-d49e71b21de1 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010958 Nov 24 15:59:20.132969 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 27/52] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Nov 24 15:59:20 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 15:59:21.542465 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-015ec63d-fce9-425b-9f9e-fe6c11714912 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:21.543485 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-015ec63d-fce9-425b-9f9e-fe6c11714912 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Nov 24 15:59:21.544056 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 26/53] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Nov 24 15:59:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:59:21.768704 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-fe7db69f-cf5a-4aaa-ab4d-e3af11704518 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:59:21.796071 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-fe7db69f-cf5a-4aaa-ab4d-e3af11704518 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.099593 Nov 24 15:59:21.796981 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 28/54] 10.222.0.72 () {64 vars in 1235 bytes} [Wed Nov 24 15:59:21 2021] POST /compute/v2.1/flavors => generated 404 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:59:23.347888 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-015ec63d-fce9-425b-9f9e-fe6c11714912 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:23.348895 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-015ec63d-fce9-425b-9f9e-fe6c11714912 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Nov 24 15:59:23.349338 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 27/55] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Nov 24 15:59:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:59:23.559839 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-a5ca1d54-aa00-4072-86f5-0ddbf882464c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:59:23.578148 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-a5ca1d54-aa00-4072-86f5-0ddbf882464c admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.078725 Nov 24 15:59:23.578711 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 29/56] 10.222.0.72 () {64 vars in 1235 bytes} [Wed Nov 24 15:59:23 2021] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:59:24.982926 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-015ec63d-fce9-425b-9f9e-fe6c11714912 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:24.983922 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-015ec63d-fce9-425b-9f9e-fe6c11714912 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Nov 24 15:59:24.984321 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 28/57] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Nov 24 15:59:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:59:25.178344 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-dc761eb7-e644-429e-a98a-b4a728813871 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:59:25.196768 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-dc761eb7-e644-429e-a98a-b4a728813871 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.073137 Nov 24 15:59:25.197259 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 30/58] 10.222.0.72 () {64 vars in 1235 bytes} [Wed Nov 24 15:59:25 2021] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:59:26.615185 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-015ec63d-fce9-425b-9f9e-fe6c11714912 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:26.616213 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-015ec63d-fce9-425b-9f9e-fe6c11714912 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Nov 24 15:59:26.616611 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 29/59] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Nov 24 15:59:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:59:26.812451 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-a974eb52-ba80-469f-b272-e5981215bc8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:59:26.830432 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-a974eb52-ba80-469f-b272-e5981215bc8e admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071968 Nov 24 15:59:26.831447 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 31/60] 10.222.0.72 () {64 vars in 1235 bytes} [Wed Nov 24 15:59:26 2021] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:59:28.233970 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-015ec63d-fce9-425b-9f9e-fe6c11714912 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:28.234987 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-015ec63d-fce9-425b-9f9e-fe6c11714912 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Nov 24 15:59:28.235387 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 30/61] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Nov 24 15:59:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:59:28.432641 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-e14208bc-1195-4c2f-afc8-7f6894824929 admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:59:28.452583 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-e14208bc-1195-4c2f-afc8-7f6894824929 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072786 Nov 24 15:59:28.453182 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 32/62] 10.222.0.72 () {60 vars in 1202 bytes} [Wed Nov 24 15:59:28 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:00:15.653107 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-015ec63d-fce9-425b-9f9e-fe6c11714912 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:00:15.654122 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-015ec63d-fce9-425b-9f9e-fe6c11714912 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Nov 24 16:00:15.654527 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 31/63] 10.222.0.72 () {54 vars in 930 bytes} [Wed Nov 24 16:00:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:00:15.719960 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-6e7d4f32-3ce0-4428-8e6f-100176e9b954 admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:00:15.739748 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-6e7d4f32-3ce0-4428-8e6f-100176e9b954 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078865 Nov 24 16:00:15.742697 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 33/64] 10.222.0.72 () {60 vars in 1291 bytes} [Wed Nov 24 16:00:15 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:00:15.763565 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-d444a33a-e643-480b-a73c-960a3c9a4f5f admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:00:15.772749 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-d444a33a-e643-480b-a73c-960a3c9a4f5f admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012723 Nov 24 16:00:15.773345 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 32/65] 10.222.0.72 () {60 vars in 1282 bytes} [Wed Nov 24 16:00:15 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:00:15.785434 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-c87455dd-b4be-4309-bdde-014f1cf32a32 admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:00:15.793223 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-c87455dd-b4be-4309-bdde-014f1cf32a32 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011388 Nov 24 16:00:15.793752 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 34/66] 10.222.0.72 () {60 vars in 1285 bytes} [Wed Nov 24 16:00:15 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:00:15.806028 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-f64a6d34-7b8e-4f1d-bb52-adf9098fab35 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:00:15.814078 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-f64a6d34-7b8e-4f1d-bb52-adf9098fab35 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011488 Nov 24 16:00:15.815787 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 33/67] 10.222.0.72 () {60 vars in 1285 bytes} [Wed Nov 24 16:00:15 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:00:15.827616 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-cea58b87-f977-46d5-9510-223fdf7cb02b admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:00:15.836094 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-cea58b87-f977-46d5-9510-223fdf7cb02b admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011933 Nov 24 16:00:15.836569 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 35/68] 10.222.0.72 () {60 vars in 1282 bytes} [Wed Nov 24 16:00:15 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:01:39.641633 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-86182738-2a14-4100-ae32-79bbaa335c92 tempest-verify_tempest_config-1450488059 tempest-verify_tempest_config-1450488059-project] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:01:39.643576 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-86182738-2a14-4100-ae32-79bbaa335c92 tempest-verify_tempest_config-1450488059 tempest-verify_tempest_config-1450488059-project] 10.222.0.72 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.109802 Nov 24 16:01:39.644112 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 34/69] 10.222.0.72 () {58 vars in 1133 bytes} [Wed Nov 24 16:01:39 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:03:08.656863 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-cea58b87-f977-46d5-9510-223fdf7cb02b admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:03:08.657909 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-cea58b87-f977-46d5-9510-223fdf7cb02b admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Nov 24 16:03:08.658311 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 36/70] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Nov 24 16:03:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:03:08.918337 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-b86f1642-3ca0-4ada-993a-d90803e4a1cc admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:03:08.920202 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:03:08.920202 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: warnings.warn(msg) Nov 24 16:03:08.921985 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-b86f1642-3ca0-4ada-993a-d90803e4a1cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:03:08.922602 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-b86f1642-3ca0-4ada-993a-d90803e4a1cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:03:08.923496 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-b86f1642-3ca0-4ada-993a-d90803e4a1cc admin admin] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:03:08.923921 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-b86f1642-3ca0-4ada-993a-d90803e4a1cc admin admin] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:03:08.959571 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-b86f1642-3ca0-4ada-993a-d90803e4a1cc admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.157561 Nov 24 16:03:08.960150 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 35/71] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Nov 24 16:03:08 2021] GET /compute/v2.1/os-services => generated 791 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:03:10.451170 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-cea58b87-f977-46d5-9510-223fdf7cb02b admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:03:10.452179 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-cea58b87-f977-46d5-9510-223fdf7cb02b admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Nov 24 16:03:10.452571 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 37/72] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Nov 24 16:03:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:03:10.651592 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-890ad576-d933-418d-973d-b6b45ec01f80 admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:03:10.652749 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:03:10.652749 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: warnings.warn(msg) Nov 24 16:03:10.654318 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-890ad576-d933-418d-973d-b6b45ec01f80 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:03:10.654769 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-890ad576-d933-418d-973d-b6b45ec01f80 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:03:10.655575 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-890ad576-d933-418d-973d-b6b45ec01f80 admin admin] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:03:10.656034 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-890ad576-d933-418d-973d-b6b45ec01f80 admin admin] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:03:10.675243 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-890ad576-d933-418d-973d-b6b45ec01f80 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077418 Nov 24 16:03:10.675819 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 36/73] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Nov 24 16:03:10 2021] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:03:22.540227 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-cea58b87-f977-46d5-9510-223fdf7cb02b admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:03:22.541262 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-cea58b87-f977-46d5-9510-223fdf7cb02b admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Nov 24 16:03:22.541656 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 38/74] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Nov 24 16:03:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:03:22.741113 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-d33170ec-d78c-44f2-851e-5600d31063ba admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:03:22.742303 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:03:22.742303 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: warnings.warn(msg) Nov 24 16:03:22.743837 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-d33170ec-d78c-44f2-851e-5600d31063ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:03:22.744285 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-d33170ec-d78c-44f2-851e-5600d31063ba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:03:22.745150 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-d33170ec-d78c-44f2-851e-5600d31063ba admin admin] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:03:22.745587 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-d33170ec-d78c-44f2-851e-5600d31063ba admin admin] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:03:22.771666 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-d33170ec-d78c-44f2-851e-5600d31063ba admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084139 Nov 24 16:03:22.772239 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 37/75] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Nov 24 16:03:22 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:03:24.204911 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: DEBUG nova.api.openstack.wsgi [None req-cea58b87-f977-46d5-9510-223fdf7cb02b admin admin] Calling method '>' {{(pid=102095) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:03:24.205953 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: INFO nova.api.openstack.requestlog [None req-cea58b87-f977-46d5-9510-223fdf7cb02b admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Nov 24 16:03:24.206349 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: [pid: 102095|app: 0|req: 39/76] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Nov 24 16:03:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:03:24.413320 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG nova.api.openstack.wsgi [None req-3fd1e9d6-be7a-4ee2-af2d-f0bcbdb6a9bc admin admin] Calling method '>' {{(pid=102096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:03:24.414409 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:03:24.414409 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: warnings.warn(msg) Nov 24 16:03:24.415979 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-3fd1e9d6-be7a-4ee2-af2d-f0bcbdb6a9bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:03:24.416425 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-3fd1e9d6-be7a-4ee2-af2d-f0bcbdb6a9bc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:03:24.417276 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-3fd1e9d6-be7a-4ee2-af2d-f0bcbdb6a9bc admin admin] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:03:24.417704 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: DEBUG oslo_concurrency.lockutils [None req-3fd1e9d6-be7a-4ee2-af2d-f0bcbdb6a9bc admin admin] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:03:24.438567 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: INFO nova.api.openstack.requestlog [None req-3fd1e9d6-be7a-4ee2-af2d-f0bcbdb6a9bc admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082978 Nov 24 16:03:24.439136 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: [pid: 102096|app: 0|req: 38/77] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Nov 24 16:03:24 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:04:21.438501 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: Wed Nov 24 16:04:21 2021 - graceful shutdown triggered... Nov 24 16:04:21.439619 dv-cinder-818994-2-iscsi devstack@n-api.service[102095]: Gracefully killing worker 1 (pid: 102095)... Nov 24 16:04:21.440112 dv-cinder-818994-2-iscsi devstack@n-api.service[102096]: Gracefully killing worker 2 (pid: 102096)... Nov 24 16:04:21.444204 dv-cinder-818994-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 24 16:04:22.439329 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: worker 1 buried after 1 seconds Nov 24 16:04:22.440309 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: worker 2 buried after 1 seconds Nov 24 16:04:22.440309 dv-cinder-818994-2-iscsi devstack@n-api.service[102094]: goodbye to uWSGI. Nov 24 16:04:22.441419 dv-cinder-818994-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 24 16:04:22.442083 dv-cinder-818994-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 24 16:04:22.445094 dv-cinder-818994-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 24 16:04:22.459140 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 24 16:04:22.462518 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 24 16:04:22 2021] *** Nov 24 16:04:22.462518 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 24 16:04:22.462518 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 24 16:04:22.462518 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: nodename: dv-cinder-818994-2-iscsi Nov 24 16:04:22.462518 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: machine: x86_64 Nov 24 16:04:22.462518 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: clock source: unix Nov 24 16:04:22.462518 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: pcre jit disabled Nov 24 16:04:22.462518 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: detected number of CPU cores: 4 Nov 24 16:04:22.462518 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: current working directory: / Nov 24 16:04:22.462518 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: detected binary path: /usr/bin/uwsgi-core Nov 24 16:04:22.462518 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: your processes number limit is 47680 Nov 24 16:04:22.462518 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: your memory page size is 4096 bytes Nov 24 16:04:22.462518 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: detected max file descriptor number: 2048 Nov 24 16:04:22.462518 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: lock engine: pthread robust mutexes Nov 24 16:04:22.463625 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: thunder lock: enabled Nov 24 16:04:22.463625 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 24 16:04:22.463625 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 24 16:04:22.513419 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: Python main interpreter initialized at 0x55ffdb2d79c0 Nov 24 16:04:22.513419 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: python threads support enabled Nov 24 16:04:22.513419 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: your server socket listen backlog is limited to 100 connections Nov 24 16:04:22.513419 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: your mercy for graceful operations on workers is 90 seconds Nov 24 16:04:22.514125 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: mapped 403077 bytes (393 KB) for 2 cores Nov 24 16:04:22.514125 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: *** Operational MODE: preforking *** Nov 24 16:04:22.514415 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: *** uWSGI is running in multiple interpreter mode *** Nov 24 16:04:22.514415 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: spawned uWSGI master process (pid: 116287) Nov 24 16:04:22.514439 dv-cinder-818994-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 24 16:04:22.515383 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: spawned uWSGI worker 1 (pid: 116303, cores: 1) Nov 24 16:04:22.517647 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: spawned uWSGI worker 2 (pid: 116304, cores: 1) Nov 24 16:04:22.517647 dv-cinder-818994-2-iscsi devstack@n-api.service[116287]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 24 16:04:24.885412 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 16:04:24.885412 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: from cryptography.utils import int_from_bytes Nov 24 16:04:24.886186 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 16:04:24.886186 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: from cryptography.utils import int_from_bytes Nov 24 16:04:25.111656 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 16:04:25.111656 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: from cryptography.utils import int_from_bytes Nov 24 16:04:25.112785 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 16:04:25.112785 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: from cryptography.utils import int_from_bytes Nov 24 16:04:27.571766 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:04:27.572369 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 16:04:27.573065 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 16:04:27.573713 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 16:04:27.574180 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 16:04:27.574854 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.575455 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.576053 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.576643 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.577166 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.577590 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.578192 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.578777 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.580022 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.580579 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.581206 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.581810 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818994-2-iscsi {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.582415 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.583041 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.583517 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.583896 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.584464 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.585133 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.585596 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.586412 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.587883 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.587883 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.588356 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.588900 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.589536 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.590129 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.590771 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.591336 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.591948 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.592488 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.593261 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818994-2-iscsi {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.593860 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.594443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.595559 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.596363 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.596939 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.597533 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.598115 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.598727 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.599289 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.599921 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.600442 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.601008 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.601633 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.602195 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.602778 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.603374 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.603992 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.604557 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.605164 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.605636 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.606230 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.606840 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.607437 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.608042 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.608528 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.608978 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.609595 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.610182 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.611607 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.612278 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.612864 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.613492 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.614089 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.614681 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.616153 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.616717 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.617353 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.617902 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.618488 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.619060 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.619658 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.620417 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.620854 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.621389 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.621963 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.622531 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.623099 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.623683 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.624285 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.624883 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.625487 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.626588 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.627199 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.628083 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.628647 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.629453 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.629708 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.630293 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.630917 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.631504 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.632099 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.632691 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.633293 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.633886 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.634472 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.635054 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.635648 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.636234 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.636814 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.637448 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.638010 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.638581 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.639203 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.639807 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.640371 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.640944 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.641542 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.642961 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.643346 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.643929 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.644513 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.645942 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.645942 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.646435 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.646934 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.647517 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.648232 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.648843 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.649429 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.650004 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.650600 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.651195 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.651789 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.652382 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.652976 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.653595 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.654138 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.654800 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.655259 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.655794 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.656387 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.656950 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.657924 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.658728 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.661373 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.662302 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:27.662873 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.663459 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.664242 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.664739 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.665375 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.665832 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.666275 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.666708 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.667269 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.667720 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.668171 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.668604 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.669065 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.669681 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.670117 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.670570 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.671158 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.671589 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.672185 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.672611 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.673258 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.673729 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.674501 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.674951 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.675582 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.676037 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.676470 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.676913 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.677509 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.677948 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.678376 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.678804 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.679230 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.679676 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.680101 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.680528 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.681084 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.681484 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.681919 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.682469 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.682887 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.683306 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.683728 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.684177 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.684765 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.685256 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.685854 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.686327 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.686767 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.687197 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.687740 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.688157 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.689212 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.689802 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.690213 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.690661 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.691087 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.691506 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.691943 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.692502 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.692931 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.693406 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.693827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.694251 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.694707 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.695146 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.695570 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.696159 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.696602 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.697067 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.697530 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.697980 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.698426 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.698859 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.699300 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.699731 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.700153 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.700580 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.701004 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.701454 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.701873 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.702311 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.702858 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.703277 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.703698 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.704230 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.705626 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.705626 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.706167 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.706594 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.707066 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.707493 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.707958 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.708411 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.708848 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.709320 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.709750 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.710182 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.710613 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.711059 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.711637 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.712087 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.712435 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.713066 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.713518 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.713967 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.714566 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.715128 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.716140 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.716140 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.716140 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.716877 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.717378 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.718002 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.718257 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.718967 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.719406 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.720370 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.720918 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.721315 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.721752 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.722275 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.722604 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.723197 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.723598 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.724072 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.724501 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.724935 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.725379 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.726054 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.726452 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.727039 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.727470 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.727901 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.728340 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.728766 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.729935 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.729935 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.730827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.731262 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.731704 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.732144 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.732578 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.733106 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.733495 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.733906 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.734336 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.734791 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.736801 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.737368 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.737720 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.738047 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.738376 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.738864 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.739354 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.739677 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.740014 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.740337 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.740652 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.740967 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.741311 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.741670 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.741993 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.742308 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.742769 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.742988 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.743337 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.743683 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.743895 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.744214 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.744551 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.744990 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.745427 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.745766 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.746108 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.746726 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.746726 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.747065 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.747338 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.747659 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.747973 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.748288 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.748605 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.749564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.749564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.749862 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.750380 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.750862 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.751498 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.751498 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.751870 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.753017 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.753017 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.753441 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.753898 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.754609 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.754934 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.755262 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.755582 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.755920 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.756238 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.756891 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.756891 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.757304 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.757805 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.758109 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.758475 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.758788 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.759935 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.759935 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.759935 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.760392 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.760392 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.760672 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.760988 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.761386 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.761707 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.762056 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.762433 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.762744 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.763231 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.763416 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.764094 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.764094 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.764413 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.764709 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.765075 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.765366 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.765676 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.765994 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.766311 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.767120 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.767416 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.767794 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.768171 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.768482 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.768808 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.769157 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.775219 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.775219 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.775219 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.775219 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.775219 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.775219 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.775219 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.775219 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.777516 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.777516 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.777516 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.777516 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.777516 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.777516 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.777516 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.777516 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.778564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.778564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.778564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.778564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.778564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.778564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.778564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.778564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.779569 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.779569 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.779569 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.779569 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.779569 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.779569 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.779569 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.779569 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.780547 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.780547 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.780547 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.780547 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.780547 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.786371 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.786371 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.786371 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.786371 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.786371 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.786371 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.786371 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.786371 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.787486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.787486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.787486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.787486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.787486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.787486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.787486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.787486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.788443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.788443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.788443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.788443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.788443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.788443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.789196 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.789743 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.790186 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.790644 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.791075 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.792206 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.792638 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.793335 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.793522 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.793967 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.794393 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.794827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.795264 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.795703 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.796138 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.796570 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.796996 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.797481 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.798587 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.799203 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.799643 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.800074 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.800504 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.800960 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.801548 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.802309 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.802309 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.802872 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.803301 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.803732 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.804219 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.804593 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.805127 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.805688 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.806031 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.806465 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.806894 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.807319 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.807741 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.808168 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.809353 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.809353 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.809353 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.810038 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.810485 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.810992 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.811537 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.812096 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.812532 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.813931 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.814336 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.814644 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.815077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.815546 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.815962 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.816410 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.816892 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.817352 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.817796 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.818243 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.818685 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.819114 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.819547 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.819969 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.820410 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.820852 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.821317 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.821931 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.822398 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.822842 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.823294 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.823873 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.824317 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.824738 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.825191 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.825620 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.826086 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.826504 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.826949 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.827372 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.827804 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.828230 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.828654 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.829659 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.830104 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.830527 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.830948 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.831396 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.831958 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.832389 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.832827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.833281 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.833717 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.834145 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.834568 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.834992 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.835429 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.835892 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.836315 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.836751 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.837234 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.837677 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.838734 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.838734 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.839039 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.839447 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.839880 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.840337 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.840758 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.842114 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.842114 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.842114 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.842693 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.843130 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.843566 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.843993 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.844420 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.845810 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.846355 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.846706 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.847170 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.847605 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.848031 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.848457 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.848879 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.849391 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.849815 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.850385 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.850824 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.851267 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.852648 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.852648 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.852648 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.853207 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.853431 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.853863 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.854298 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.854726 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.855158 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.855723 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.856006 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.856439 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.856869 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.857357 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.858054 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.858521 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.858996 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.859422 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.859885 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.860694 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.860694 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.861375 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.861625 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.862933 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.862933 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.862933 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.864881 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.864881 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.864881 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.864881 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.864881 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.865637 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.865637 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.866257 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.866582 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.867058 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.867389 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.867721 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.868043 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.868367 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.868689 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.869018 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.869371 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.869693 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.870016 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.870419 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.870749 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.871091 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.871443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.871771 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.872097 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.872427 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.872740 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.873434 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.873755 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.874101 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.874434 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.874768 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.875095 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.875420 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.875756 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.876258 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.876895 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.876895 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.877710 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.877964 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.878211 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.878541 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.878855 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.879183 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.879501 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.880082 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.880435 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.880758 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.881119 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.881450 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.881771 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.882083 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.882423 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.882737 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.883052 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.883371 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.883686 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.883995 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.884449 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.884883 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.885296 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.885605 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.887239 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.887239 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.887239 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.887239 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.887239 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.888453 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.888453 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.888453 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.888453 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.889440 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.889440 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.889440 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.890198 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.890198 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.890690 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.890690 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.891280 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.891280 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.892283 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.892533 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.893342 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.893342 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.894177 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.894177 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.894177 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.895052 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.895052 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.895560 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.895560 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.896039 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.896426 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.896854 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.897228 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.897906 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.898166 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.898496 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.898775 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.899200 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.899456 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.899713 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.900040 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.900430 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.900772 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.901176 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.901577 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.901958 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.902314 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.902638 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.903011 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.903337 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.903667 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.903991 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.904315 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.904635 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.904974 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.905397 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.905648 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.905974 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.906316 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.906635 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.906949 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.909069 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.909405 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.909751 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.910097 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.910427 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.910772 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.911115 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.911442 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.911775 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.912098 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.912443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.912796 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.913163 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.913504 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.913820 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.914134 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.914459 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.914778 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.915120 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.915467 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.916568 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.916568 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.916568 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.917408 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.917408 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.917896 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.917896 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.918367 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.918624 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.918902 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.919147 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.919398 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.919647 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.919958 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.920274 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.920589 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.920924 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.921288 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.921604 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.921938 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.922264 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.922629 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.923448 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.923766 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.924112 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.924430 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.924772 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.925086 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.925407 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.925728 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.926078 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.926417 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.926749 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.927083 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.927422 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.927776 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.928096 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.928451 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.928783 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.929131 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.929456 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.929767 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:27.930042 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 16:04:27.957095 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_db.sqlalchemy.engines [None req-8268a4c9-a577-4d23-b6dc-87af1d351fc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 16:04:28.134443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.context [None req-8268a4c9-a577-4d23-b6dc-87af1d351fc6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e04849b7-0f13-4ee3-8a70-886919bfc8c5(cell1) {{(pid=116304) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 16:04:28.139178 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8268a4c9-a577-4d23-b6dc-87af1d351fc6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:04:28.141117 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8268a4c9-a577-4d23-b6dc-87af1d351fc6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:04:28.142812 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8268a4c9-a577-4d23-b6dc-87af1d351fc6 None None] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:04:28.144358 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8268a4c9-a577-4d23-b6dc-87af1d351fc6 None None] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:04:28.158013 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_db.sqlalchemy.engines [None req-8268a4c9-a577-4d23-b6dc-87af1d351fc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 16:04:28.159215 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_db.sqlalchemy.engines [None req-8268a4c9-a577-4d23-b6dc-87af1d351fc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 16:04:28.253324 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 16:04:28.254207 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 16:04:28.254207 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 16:04:28.254666 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 16:04:28.254832 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 16:04:28.255095 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.255431 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.255759 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.256083 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.256422 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.256736 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.257116 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.257449 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.257789 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.258061 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.258381 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.258713 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818994-2-iscsi {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.259043 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.259363 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.259682 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.260010 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.260321 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.260653 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.260977 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.261536 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.261874 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.262163 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.262489 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.262845 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.263165 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.263481 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.263810 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.264128 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.264462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.264775 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.265216 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818994-2-iscsi {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.265545 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.265866 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.266189 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.266671 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.267506 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.267821 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.268149 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.268478 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.268793 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.269154 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.269483 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.269811 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.270137 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.270444 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.270761 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.271075 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.271400 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.271711 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.272022 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.272281 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.272592 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.272928 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.273282 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.273616 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.273870 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.274124 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.274451 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.274776 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.275091 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.275406 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.275715 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.276025 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.276334 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.276647 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.276957 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.277294 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.277627 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.277949 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.278277 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.278588 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.278914 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.279328 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.279586 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.279897 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.280245 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.280569 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.280885 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.281237 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.281564 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.281936 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.282226 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.282570 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.282900 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.283248 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.283561 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.283837 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.284116 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.284434 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.284765 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.285106 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.285426 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.285812 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.286038 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.286508 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.287017 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.287410 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.287674 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.287952 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.288273 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.288696 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.288939 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.290733 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.290733 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.290733 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.290733 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.290733 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.291935 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.291935 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.291935 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.291935 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.292896 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.292896 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.292896 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.292896 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.293878 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.293878 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.294342 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.294342 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.295034 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.295034 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.295490 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.295753 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.296153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.296446 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.296803 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.297122 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.297366 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.297612 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.298000 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.298450 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.298913 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.299341 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.299714 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.300145 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.300444 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.300747 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 16:04:28.301162 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.301466 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.301823 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.302156 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.302499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.302832 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.303155 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.303475 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.303798 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.304134 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.304454 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.304779 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.305155 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.305457 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.305783 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.306127 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.306451 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.306821 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.307367 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.307601 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.308029 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.308319 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.308621 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.309148 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.309403 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.309831 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.310167 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.310504 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.311057 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.311425 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.311788 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.312164 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.312558 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.312913 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.313267 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.314264 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.314774 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.315210 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.315469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.315729 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.316036 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.316457 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.316707 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.316958 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.317314 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.317658 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.317977 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.318324 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.318640 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.318959 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.319427 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.319679 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.320097 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.320364 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.320614 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.320860 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.321180 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.321956 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.321956 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.322290 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.322573 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.322873 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.323321 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.323805 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.323978 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.324258 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.324584 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.324903 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.325316 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.325637 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.326074 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.326380 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.326762 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.327043 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.327359 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.327678 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.327992 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.328404 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.328616 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.330255 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.330255 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.330255 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.330675 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.330961 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.331215 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.331562 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.331880 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.332195 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.332530 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.332823 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.333210 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.333525 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.333880 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.334227 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.334558 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.334891 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.335213 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.335535 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.335854 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.336181 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.336499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.336825 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.337183 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.337507 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.337836 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.338155 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.338494 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.338812 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.339142 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.339456 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.339781 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.340148 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.340478 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.340820 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.341168 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.341489 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.341815 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.342139 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.342457 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.342777 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.343109 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.343423 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.343882 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.344070 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.344379 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.344791 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.346829 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.347220 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.347561 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.347916 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.348419 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.348641 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.348974 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.349338 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.349682 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.350016 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.350338 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.350660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.350981 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.351312 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.351636 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.351965 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.352289 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.352612 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.352932 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.353286 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.353616 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.353938 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.354252 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.354579 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.354915 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.355238 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.355571 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.355910 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.356235 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.356553 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.356881 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.357273 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.357587 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.357904 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.358224 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.358584 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.358903 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.359221 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.359696 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.359915 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.360409 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.360806 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.361957 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.361957 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.361957 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.362365 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.362489 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.362778 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.363097 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.363450 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.363773 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.364108 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.364425 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.364777 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.365935 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.365935 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.365935 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.366404 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.366771 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.367115 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.367439 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.367769 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.368097 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.368424 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.368765 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.369129 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.369474 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.369771 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.370097 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.370519 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.370716 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.371018 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.371334 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.371658 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.371973 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.372294 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.372754 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.372968 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.373314 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.373574 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.373903 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.374222 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.374540 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.374856 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.375240 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.375512 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.375830 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.376804 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.377881 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.377881 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.378135 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.378360 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.378698 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.379057 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.379377 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.379538 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_db.sqlalchemy.engines [None req-8268a4c9-a577-4d23-b6dc-87af1d351fc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 16:04:28.379774 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.380254 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.380535 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.380688 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.383378 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.383378 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.383378 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.383378 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.383378 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.383378 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.383378 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.383378 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.384655 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.384655 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.384655 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.384655 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.384655 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.387429 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.387429 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.387429 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.387429 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.387429 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.387429 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.387429 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.387429 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.388700 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.388700 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.388700 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.388700 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.388700 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.389630 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.389630 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.389630 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.390226 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.390226 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.390595 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.390728 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.391040 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.391360 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.392386 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.392752 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.393105 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.393628 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.393955 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.394275 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.394598 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.394913 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.395229 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.395546 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.395860 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.396174 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.396486 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.396824 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.397168 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.397485 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.397800 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.398111 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.398467 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.398790 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.399159 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.399468 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.399874 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.400103 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.400424 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.400742 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.401084 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.401399 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.401723 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.402042 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.402363 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.402675 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.402995 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.403320 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.403641 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.403966 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.404298 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.404632 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.404969 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.405368 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.405687 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.406008 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.406326 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.406647 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.406966 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.407845 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.408317 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.408651 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.409631 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.409631 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.410323 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.410323 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.410323 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.410691 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.411339 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.413608 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.414132 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.415059 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.415464 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.415755 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.416235 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.417136 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.417520 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.418014 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.418541 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.418978 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.419412 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.420283 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.420946 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.421419 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.421982 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.422421 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.424539 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.425002 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.425499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.425946 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.426404 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.426852 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.427289 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.427724 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.428150 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.428762 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.430278 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.431368 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.431948 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.432393 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.432818 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.433472 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.434420 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.434854 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.435371 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.435833 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.436567 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.436807 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.437380 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.437897 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.439392 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.442462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.442462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.442462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.442462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.442462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.443325 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.443636 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.444320 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.444772 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.445372 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.447006 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.447676 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.448184 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.449530 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.449530 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.450065 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.450861 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.451989 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.452266 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.452879 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.453421 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.453914 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.454633 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.455099 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.455608 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.456214 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.456696 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.457612 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.458105 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.458624 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.459174 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.459664 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.460954 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.460954 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.461599 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.462019 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.462772 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.463498 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.464836 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.464836 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.466195 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.466195 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.466729 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.468043 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.468043 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.470442 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.470918 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.472090 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.472090 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.472989 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.473604 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.474176 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.474798 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.475379 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.475952 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.477687 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.478298 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.479332 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.479964 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.480529 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.481172 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.481619 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.482020 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.482382 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.482993 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.483300 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.483876 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.484214 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.484681 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.484941 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.486275 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.486778 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.487238 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.487594 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.488126 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.490329 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.490329 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.490329 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.490329 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.490329 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.490329 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.497514 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.497514 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.497514 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.497514 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.497514 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.497514 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.497514 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.497514 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.498469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.498469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.498469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.498469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.498469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.498469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.498469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.498469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.502913 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.502913 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.502913 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.502913 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.502913 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.502913 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.502913 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.504694 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.504694 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.504694 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.504694 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.504694 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.504694 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.504694 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.504694 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.506683 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.506683 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.506683 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.506683 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.506683 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.506683 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.506683 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.506683 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.508597 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.508597 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.508597 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.508597 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.508597 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.508597 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.508597 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.510348 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.510348 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.510348 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.510348 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.510348 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.517846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.517846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.517846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.517846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.517846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.517846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.517846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.517846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.519835 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.519835 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.519835 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.519835 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.519835 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.519835 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.519835 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.519835 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.522139 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.522139 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.522139 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.522139 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.522139 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.522139 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.522139 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.522139 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.525722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.525722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.525722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.525722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.525722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.525722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.525722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.525722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.527697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.527697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.527697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.527697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.527697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.527697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.527697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.527697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.530355 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.530355 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.530355 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.530355 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.530355 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.530355 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.530355 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.530355 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.533499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.533499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.533499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.533499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.533499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.533499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.533499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.533499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.541021 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.541021 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.541021 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.541021 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.541021 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.541021 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.541021 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.541021 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.543709 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.543709 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.543709 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.543709 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.543709 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.543709 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.543709 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.543709 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.545972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.545972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.545972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.545972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.545972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.545972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.545972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.545972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.550071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.550071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.550071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.550071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.550071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.550071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.550071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.550071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.552065 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.552065 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.552065 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.552065 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.552065 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.552065 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.552065 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.554212 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.554212 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.554212 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.560970 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.561704 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.562634 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.563205 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.564065 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.564396 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.564951 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.566167 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.566966 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.567451 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.567954 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.568460 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.568952 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.569935 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.570245 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.570649 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.571136 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.571614 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.572106 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.572583 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.573120 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.573594 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.574297 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.574698 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.575242 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.575857 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.576339 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.576938 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.577449 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.577928 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.578448 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.578926 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.580713 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.580713 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.582857 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.582857 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.582857 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.582857 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.584176 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.584176 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.584998 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.585450 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.585822 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.586704 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.587309 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.587832 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.588342 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.588823 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.589349 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.589846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.590704 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 16:04:28.590992 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 16:04:28.620427 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_db.sqlalchemy.engines [None req-f7b9d3aa-a39e-492b-91a2-38e5271cf847 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 16:04:28.791715 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.context [None req-f7b9d3aa-a39e-492b-91a2-38e5271cf847 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e04849b7-0f13-4ee3-8a70-886919bfc8c5(cell1) {{(pid=116303) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 16:04:28.799658 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f7b9d3aa-a39e-492b-91a2-38e5271cf847 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:04:28.801678 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f7b9d3aa-a39e-492b-91a2-38e5271cf847 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:04:28.803192 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f7b9d3aa-a39e-492b-91a2-38e5271cf847 None None] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:04:28.810651 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f7b9d3aa-a39e-492b-91a2-38e5271cf847 None None] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:04:28.828362 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_db.sqlalchemy.engines [None req-f7b9d3aa-a39e-492b-91a2-38e5271cf847 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 16:04:28.833417 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_db.sqlalchemy.engines [None req-f7b9d3aa-a39e-492b-91a2-38e5271cf847 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 16:04:28.880826 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: WARNING keystonemiddleware.auth_token [None req-8268a4c9-a577-4d23-b6dc-87af1d351fc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 16:04:28.889202 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: WARNING keystonemiddleware.auth_token [None req-8268a4c9-a577-4d23-b6dc-87af1d351fc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 16:04:29.194023 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_db.sqlalchemy.engines [None req-f7b9d3aa-a39e-492b-91a2-38e5271cf847 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 16:04:29.305185 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: WARNING keystonemiddleware.auth_token [None req-8268a4c9-a577-4d23-b6dc-87af1d351fc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 16:04:29.312559 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: WARNING keystonemiddleware.auth_token [None req-8268a4c9-a577-4d23-b6dc-87af1d351fc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 16:04:29.324037 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ffdb2d79c0 pid: 116304 (default app) Nov 24 16:04:29.738282 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: WARNING keystonemiddleware.auth_token [None req-f7b9d3aa-a39e-492b-91a2-38e5271cf847 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 16:04:29.745544 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: WARNING keystonemiddleware.auth_token [None req-f7b9d3aa-a39e-492b-91a2-38e5271cf847 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 16:04:29.990804 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: WARNING keystonemiddleware.auth_token [None req-f7b9d3aa-a39e-492b-91a2-38e5271cf847 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 16:04:29.996605 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: WARNING keystonemiddleware.auth_token [None req-f7b9d3aa-a39e-492b-91a2-38e5271cf847 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 16:04:30.003264 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ffdb2d79c0 pid: 116303 (default app) Nov 24 16:05:08.713606 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-682a7d22-ffa3-4af2-8d93-6f5f32361104 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] Action: 'create', calling method: .version_select at 0x7f361c955550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-389085005", "metadata": {"Type": "work"}}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:09.319299 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b97afb58-9f4a-456b-8d38-781f204da864 tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] Action: 'create', calling method: .version_select at 0x7f361cfc1dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1565181527", "metadata": {"Type": "work"}}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:09.321042 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b97afb58-9f4a-456b-8d38-781f204da864 tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:05:09.322022 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b97afb58-9f4a-456b-8d38-781f204da864 tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.935828 Nov 24 16:05:09.323363 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 1/1] 10.222.0.72 () {60 vars in 1155 bytes} [Wed Nov 24 16:05:07 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1939 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 24 16:05:09.343012 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0741a38e-d27e-441f-b9d0-8a9512666c69 tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] Action: 'create', calling method: .version_select at 0x7f361c90bee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-289717903", "metadata": {"Type": "work"}}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:09.348709 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0741a38e-d27e-441f-b9d0-8a9512666c69 tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:05:09.350254 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0741a38e-d27e-441f-b9d0-8a9512666c69 tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011159 Nov 24 16:05:09.351399 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 2/2] 10.222.0.72 () {60 vars in 1155 bytes} [Wed Nov 24 16:05:09 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 24 16:05:09.366261 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2040c600-317f-4a36-80bc-a1a5b8dd12ef tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] Action: 'create', calling method: .version_select at 0x7f361c9c4ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2080219327", "metadata": {"Type": "work"}}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:09.368722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2040c600-317f-4a36-80bc-a1a5b8dd12ef tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:05:09.369891 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2040c600-317f-4a36-80bc-a1a5b8dd12ef tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007856 Nov 24 16:05:09.370724 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 3/3] 10.222.0.72 () {60 vars in 1155 bytes} [Wed Nov 24 16:05:09 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 24 16:05:09.386959 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3428f14f-91b6-4548-8bb0-cd4d19b8fe2a tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] Calling method '.version_select at 0x7f361c924940>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:09.943550 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-3428f14f-91b6-4548-8bb0-cd4d19b8fe2a tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] HTTP exception thrown: Volume tempest-invalid-659278396 could not be found. Nov 24 16:05:09.944090 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3428f14f-91b6-4548-8bb0-cd4d19b8fe2a tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] Returning 404 to user: Volume tempest-invalid-659278396 could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:05:09.945015 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3428f14f-91b6-4548-8bb0-cd4d19b8fe2a tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/tempest-invalid-659278396" status: 404 len: 98 microversion: 2.1 time: 0.562736 Nov 24 16:05:09.945601 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 4/4] 10.222.0.72 () {58 vars in 1214 bytes} [Wed Nov 24 16:05:09 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-659278396 => generated 98 bytes in 564 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 24 16:05:09.961814 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2bd7196a-7a88-490a-a00c-417e78e40481 tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004827 Nov 24 16:05:09.962705 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 5/5] 10.222.0.72 () {58 vars in 1139 bytes} [Wed Nov 24 16:05:09 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 24 16:05:09.978272 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4794f893-bf6f-443e-8b2e-3b8c49d3213c tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004512 Nov 24 16:05:09.978843 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 6/6] 10.222.0.72 () {58 vars in 1136 bytes} [Wed Nov 24 16:05:09 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 24 16:05:09.994480 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-23d68145-3bd2-4fbf-8e22-63ed0f2c7660 tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] Calling method '.version_select at 0x7f361c7cb700>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:10.058332 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-23d68145-3bd2-4fbf-8e22-63ed0f2c7660 tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] HTTP exception thrown: Volume fc29c5a2-ae2b-4756-a9e6-9aedb480c710 could not be found. Nov 24 16:05:10.060890 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-23d68145-3bd2-4fbf-8e22-63ed0f2c7660 tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] Returning 404 to user: Volume fc29c5a2-ae2b-4756-a9e6-9aedb480c710 could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:05:10.064318 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-23d68145-3bd2-4fbf-8e22-63ed0f2c7660 tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/fc29c5a2-ae2b-4756-a9e6-9aedb480c710" status: 404 len: 109 microversion: 2.1 time: 0.073270 Nov 24 16:05:10.066557 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 7/7] 10.222.0.72 () {58 vars in 1247 bytes} [Wed Nov 24 16:05:09 2021] DELETE /compute/v2.1/os-volumes/fc29c5a2-ae2b-4756-a9e6-9aedb480c710 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 16:05:10.096934 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-facd89ad-0dbb-481f-a60f-497e7625021d tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] Calling method '.version_select at 0x7f361c7e0310>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:10.178035 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-facd89ad-0dbb-481f-a60f-497e7625021d tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] HTTP exception thrown: Volume a682d76a-59dc-41ea-943f-b95dd29c830c could not be found. Nov 24 16:05:10.181607 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-facd89ad-0dbb-481f-a60f-497e7625021d tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] Returning 404 to user: Volume a682d76a-59dc-41ea-943f-b95dd29c830c could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:05:10.184575 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-facd89ad-0dbb-481f-a60f-497e7625021d tempest-VolumesNegativeTest-2060700133 tempest-VolumesNegativeTest-2060700133-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/a682d76a-59dc-41ea-943f-b95dd29c830c" status: 404 len: 109 microversion: 2.1 time: 0.101653 Nov 24 16:05:10.198102 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 8/8] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:05:10 2021] GET /compute/v2.1/os-volumes/a682d76a-59dc-41ea-943f-b95dd29c830c => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:05:11.270215 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-682a7d22-ffa3-4af2-8d93-6f5f32361104 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.801887 Nov 24 16:05:11.284001 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 1/9] 10.222.0.72 () {60 vars in 1155 bytes} [Wed Nov 24 16:05:06 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 4819 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 24 16:05:11.290975 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f6f38783-17b1-4543-8033-c57771512f09 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] Calling method '.version_select at 0x7f361c7cb790>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:11.532473 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f6f38783-17b1-4543-8033-c57771512f09 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/00f77c50-a7a6-4107-b889-0f4d22d4465a" status: 200 len: 352 microversion: 2.1 time: 0.245758 Nov 24 16:05:11.535813 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 9/10] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:05:11 2021] GET /compute/v2.1/os-volumes/00f77c50-a7a6-4107-b889-0f4d22d4465a => generated 352 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:05:12.550228 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4d535fa5-3378-4668-b2f4-deb5fb759c19 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] Calling method '.version_select at 0x7f361c81f160>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:12.647924 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4d535fa5-3378-4668-b2f4-deb5fb759c19 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/00f77c50-a7a6-4107-b889-0f4d22d4465a" status: 200 len: 352 microversion: 2.1 time: 0.103676 Nov 24 16:05:12.649979 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 2/11] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:05:12 2021] GET /compute/v2.1/os-volumes/00f77c50-a7a6-4107-b889-0f4d22d4465a => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:05:13.662928 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-01ee6a17-becd-4696-ae95-962c51da9523 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] Calling method '.version_select at 0x7f361c7e0700>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:13.808787 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-01ee6a17-becd-4696-ae95-962c51da9523 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/00f77c50-a7a6-4107-b889-0f4d22d4465a" status: 200 len: 353 microversion: 2.1 time: 0.150219 Nov 24 16:05:13.809510 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 10/12] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:05:13 2021] GET /compute/v2.1/os-volumes/00f77c50-a7a6-4107-b889-0f4d22d4465a => generated 353 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:05:13.840678 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-da3f5d32-0924-474d-928c-4be0efe3dd53 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] Calling method '.version_select at 0x7f361c81f9d0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:13.935891 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-da3f5d32-0924-474d-928c-4be0efe3dd53 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/00f77c50-a7a6-4107-b889-0f4d22d4465a" status: 200 len: 353 microversion: 2.1 time: 0.117010 Nov 24 16:05:13.936978 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 3/13] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:05:13 2021] GET /compute/v2.1/os-volumes/00f77c50-a7a6-4107-b889-0f4d22d4465a => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:05:13.955303 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c074ae06-c1ac-477d-83a5-cef85d1a1bb2 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] Calling method '.version_select at 0x7f361c76e040>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:14.134119 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c074ae06-c1ac-477d-83a5-cef85d1a1bb2 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/00f77c50-a7a6-4107-b889-0f4d22d4465a" status: 202 len: 0 microversion: 2.1 time: 0.183827 Nov 24 16:05:14.135266 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 11/14] 10.222.0.72 () {58 vars in 1247 bytes} [Wed Nov 24 16:05:13 2021] DELETE /compute/v2.1/os-volumes/00f77c50-a7a6-4107-b889-0f4d22d4465a => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:05:14.144182 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2a2c7db0-0bbb-49be-ba67-7f19425e32ff tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] Calling method '.version_select at 0x7f361c81fa60>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:14.397243 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2a2c7db0-0bbb-49be-ba67-7f19425e32ff tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/00f77c50-a7a6-4107-b889-0f4d22d4465a" status: 200 len: 352 microversion: 2.1 time: 0.255965 Nov 24 16:05:14.399113 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 4/15] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:05:14 2021] GET /compute/v2.1/os-volumes/00f77c50-a7a6-4107-b889-0f4d22d4465a => generated 352 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:05:15.309419 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-51f0d54f-9426-4614-a1ea-8544f044d0a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'create', calling method: .version_select at 0x7f361c7e0b80>, body: {"keypair": {"name": "tempest-keypair-545693207"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:15.488770 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-51f0d54f-9426-4614-a1ea-8544f044d0a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Getting quotas for project 4ca913475fb04e7a8ea75d95578c8b84. Resources: {'key_pairs'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:05:15.517555 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-51f0d54f-9426-4614-a1ea-8544f044d0a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Getting quotas for user 8a8a03093ef0437eb8da451bee7dcade and project 4ca913475fb04e7a8ea75d95578c8b84. Resources: {'key_pairs'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:05:15.668322 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-62483562", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "networks": [{"uuid": "3a3f8b84-e6ed-4689-a795-ab7b4d769ab7"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:15.889390 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] validate_networks() for [('3a3f8b84-e6ed-4689-a795-ab7b4d769ab7', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:05:16.058792 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-51f0d54f-9426-4614-a1ea-8544f044d0a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Getting quotas for project 4ca913475fb04e7a8ea75d95578c8b84. Resources: {'key_pairs'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:05:16.064938 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-51f0d54f-9426-4614-a1ea-8544f044d0a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Getting quotas for user 8a8a03093ef0437eb8da451bee7dcade and project 4ca913475fb04e7a8ea75d95578c8b84. Resources: {'key_pairs'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:05:16.084417 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-51f0d54f-9426-4614-a1ea-8544f044d0a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.349870 Nov 24 16:05:16.085711 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 12/16] 10.222.0.72 () {62 vars in 1198 bytes} [Wed Nov 24 16:05:14 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1352 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Nov 24 16:05:16.092046 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0c267e66-e520-4304-9ff7-709f17e411a8 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] Calling method '.version_select at 0x7f361c72ee50>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:16.171999 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-0c267e66-e520-4304-9ff7-709f17e411a8 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] HTTP exception thrown: Volume 00f77c50-a7a6-4107-b889-0f4d22d4465a could not be found. Nov 24 16:05:16.173537 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0c267e66-e520-4304-9ff7-709f17e411a8 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] Returning 404 to user: Volume 00f77c50-a7a6-4107-b889-0f4d22d4465a could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:05:16.179251 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0c267e66-e520-4304-9ff7-709f17e411a8 tempest-VolumesGetTestJSON-441346724 tempest-VolumesGetTestJSON-441346724-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/00f77c50-a7a6-4107-b889-0f4d22d4465a" status: 404 len: 109 microversion: 2.1 time: 0.092084 Nov 24 16:05:16.183972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 13/17] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:05:16 2021] GET /compute/v2.1/os-volumes/00f77c50-a7a6-4107-b889-0f4d22d4465a => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:05:16.893937 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1876796012", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "networks": [{"uuid": "fafb4435-765d-4616-9638-8248f7ef836b"}]}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:17.104685 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.network.neutron [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] validate_networks() for [('fafb4435-765d-4616-9638-8248f7ef836b', None, None, None, None, None)] {{(pid=116303) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:05:19.095621 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:05:19.096287 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:05:19.096585 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:05:19.097354 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:05:19.098094 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:05:19.141544 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:19.142008 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:19.142892 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:19.143331 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:19.249373 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Getting quotas for project c127095ad8cc41098ef0dd79f4fcd589. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:05:19.258070 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Getting quotas for user b4302d75c88647c39a07b19b1bbc9d5a and project c127095ad8cc41098ef0dd79f4fcd589. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:05:19.279086 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:05:19.283303 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:05:19.480432 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cf2fd333-22c4-4320-85ea-0b1e0e3078ea tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.158233 Nov 24 16:05:19.481560 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 5/18] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:05:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 4160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 16:05:19.493324 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a15a9bcd-6795-4cb0-9e7b-e6be1faf41e0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:19.494226 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a15a9bcd-6795-4cb0-9e7b-e6be1faf41e0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:19.728107 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a15a9bcd-6795-4cb0-9e7b-e6be1faf41e0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:19.783443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a15a9bcd-6795-4cb0-9e7b-e6be1faf41e0 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1213 microversion: 2.1 time: 0.294107 Nov 24 16:05:19.790222 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 6/19] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:19 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1213 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:19.860846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Flavor limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:05:19.861957 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Image limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:05:19.862588 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Flavor pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:05:19.863674 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Image pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:05:19.864664 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:05:19.909423 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:19.910074 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:19.912646 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:19.914322 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:19.973392 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Getting quotas for project 20c9176ab8ef44ffb17eda5f41aca2a8. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:05:19.994452 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Getting quotas for user 9fe7f58143cd4ee2bc161e220fbbbd12 and project 20c9176ab8ef44ffb17eda5f41aca2a8. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:05:20.030351 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Going to run 1 instances... {{(pid=116303) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:05:20.036708 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:05:20.337929 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-43318515-929e-4bec-a425-0fd4cac44f1d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.152030 Nov 24 16:05:20.339471 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 14/20] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:05:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 4154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:05:20.370412 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c298b9ec-5af8-4ab3-9502-c62a1086d328 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:20.373498 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c298b9ec-5af8-4ab3-9502-c62a1086d328 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:20.611434 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c298b9ec-5af8-4ab3-9502-c62a1086d328 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:20.646213 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c298b9ec-5af8-4ab3-9502-c62a1086d328 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1218 microversion: 2.1 time: 0.277025 Nov 24 16:05:20.647407 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 7/21] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:20 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1218 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:20.816288 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0cb4acf6-23a9-4ff0-8ab1-7ac75f2ee532 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:20.816907 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0cb4acf6-23a9-4ff0-8ab1-7ac75f2ee532 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:21.179366 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-0cb4acf6-23a9-4ff0-8ab1-7ac75f2ee532 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:21.234570 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0cb4acf6-23a9-4ff0-8ab1-7ac75f2ee532 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1213 microversion: 2.1 time: 0.419365 Nov 24 16:05:21.243082 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 15/22] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:20 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1213 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:21.672884 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a65d4818-7350-4cf0-b8d6-69e8d2968734 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:21.673378 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a65d4818-7350-4cf0-b8d6-69e8d2968734 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:22.185562 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a65d4818-7350-4cf0-b8d6-69e8d2968734 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:22.232015 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a65d4818-7350-4cf0-b8d6-69e8d2968734 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1218 microversion: 2.1 time: 0.552087 Nov 24 16:05:22.232941 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 8/23] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:21 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1218 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:22.266668 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6fb1dbfa-0df3-4c16-bf3f-e82a086964d3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:22.267970 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6fb1dbfa-0df3-4c16-bf3f-e82a086964d3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:22.619399 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1112861742", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "282e5dca-255c-487d-a4fd-a70d7293f6b8"}], "security_groups": [{"name": "tempest-securitygroup--1373701052"}], "key_name": "tempest-keypair-545693207", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:22.711715 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6fb1dbfa-0df3-4c16-bf3f-e82a086964d3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:22.754672 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6fb1dbfa-0df3-4c16-bf3f-e82a086964d3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1213 microversion: 2.1 time: 0.492087 Nov 24 16:05:22.765760 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 16/24] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:22 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1213 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:22.916266 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] validate_networks() for [('282e5dca-255c-487d-a4fd-a70d7293f6b8', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:05:23.267950 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b89e9930-b450-4c80-ad0a-ac01836f6bd7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:23.269804 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b89e9930-b450-4c80-ad0a-ac01836f6bd7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:23.583346 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b89e9930-b450-4c80-ad0a-ac01836f6bd7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:23.600367 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b89e9930-b450-4c80-ad0a-ac01836f6bd7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1218 microversion: 2.1 time: 0.344420 Nov 24 16:05:23.605484 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 17/25] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:23 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1218 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:23.802825 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-67f55eb4-d146-40a0-9144-21424f576e37 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:23.804037 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-67f55eb4-d146-40a0-9144-21424f576e37 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:23.844025 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-67f55eb4-d146-40a0-9144-21424f576e37 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:23.846320 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-67f55eb4-d146-40a0-9144-21424f576e37 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:23.850541 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-67f55eb4-d146-40a0-9144-21424f576e37 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:23.856368 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-67f55eb4-d146-40a0-9144-21424f576e37 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:23.954831 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:05:23.955953 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:05:23.956613 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:05:23.957457 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:05:23.958035 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:05:23.984289 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:23.985050 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:23.986114 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:23.986721 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:24.050954 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Getting quotas for project 4ca913475fb04e7a8ea75d95578c8b84. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:05:24.068174 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Getting quotas for user 8a8a03093ef0437eb8da451bee7dcade and project 4ca913475fb04e7a8ea75d95578c8b84. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:05:24.097921 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:05:24.115694 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:05:24.295311 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f1b6e5fc-4539-4d93-a4be-fb6e709f4549 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.680551 Nov 24 16:05:24.302931 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 9/26] 10.222.0.72 () {62 vars in 1187 bytes} [Wed Nov 24 16:05:22 2021] POST /compute/v2.1/servers => generated 402 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 24 16:05:24.320124 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6ca372e0-8e84-483b-adfc-4dbe7c106c96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:24.320756 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6ca372e0-8e84-483b-adfc-4dbe7c106c96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:24.486800 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6ca372e0-8e84-483b-adfc-4dbe7c106c96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:24.505967 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6ca372e0-8e84-483b-adfc-4dbe7c106c96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:24.510074 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6ca372e0-8e84-483b-adfc-4dbe7c106c96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:24.515769 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6ca372e0-8e84-483b-adfc-4dbe7c106c96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1281 microversion: 2.20 time: 0.197868 Nov 24 16:05:24.519782 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 10/27] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:24 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1281 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:05:24.642069 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ef744a58-266d-4693-b391-eed592c93a6b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:24.650023 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ef744a58-266d-4693-b391-eed592c93a6b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:24.672568 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef744a58-266d-4693-b391-eed592c93a6b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:24.678532 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef744a58-266d-4693-b391-eed592c93a6b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:24.684242 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef744a58-266d-4693-b391-eed592c93a6b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:24.686167 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef744a58-266d-4693-b391-eed592c93a6b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:24.912243 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-67f55eb4-d146-40a0-9144-21424f576e37 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:24.963996 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-67f55eb4-d146-40a0-9144-21424f576e37 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1217 microversion: 2.1 time: 1.173295 Nov 24 16:05:24.971521 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 18/28] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:23 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1217 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:25.334905 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ef744a58-266d-4693-b391-eed592c93a6b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:25.378074 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ef744a58-266d-4693-b391-eed592c93a6b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1270 microversion: 2.1 time: 0.749331 Nov 24 16:05:25.388943 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 11/29] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:24 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1270 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:25.555046 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-58064941-947a-4145-a7b8-c477cefe980c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:25.555660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-58064941-947a-4145-a7b8-c477cefe980c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:26.002837 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d792e822-ffc6-4a82-a823-adcf9add106c tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:26.004300 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d792e822-ffc6-4a82-a823-adcf9add106c tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:26.019657 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d792e822-ffc6-4a82-a823-adcf9add106c tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:26.021686 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d792e822-ffc6-4a82-a823-adcf9add106c tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:26.023609 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d792e822-ffc6-4a82-a823-adcf9add106c tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:26.024613 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d792e822-ffc6-4a82-a823-adcf9add106c tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:26.177242 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-58064941-947a-4145-a7b8-c477cefe980c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:26.194188 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-58064941-947a-4145-a7b8-c477cefe980c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:26.230416 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-58064941-947a-4145-a7b8-c477cefe980c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:26.246795 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-58064941-947a-4145-a7b8-c477cefe980c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1281 microversion: 2.20 time: 0.687939 Nov 24 16:05:26.249443 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 19/30] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:25 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1281 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:05:26.393243 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d792e822-ffc6-4a82-a823-adcf9add106c tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:26.414064 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-da2e54c7-aae2-4388-a876-11ce64e079d1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:26.415182 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-da2e54c7-aae2-4388-a876-11ce64e079d1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:26.423189 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d792e822-ffc6-4a82-a823-adcf9add106c tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1273 microversion: 2.1 time: 0.411668 Nov 24 16:05:26.431879 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 12/31] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:25 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1273 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:26.500705 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-da2e54c7-aae2-4388-a876-11ce64e079d1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:26.508800 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-da2e54c7-aae2-4388-a876-11ce64e079d1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:26.531727 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-da2e54c7-aae2-4388-a876-11ce64e079d1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:26.532407 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-da2e54c7-aae2-4388-a876-11ce64e079d1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:27.293169 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e91afdc3-21f1-4ecb-be14-20005df22e8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:27.296762 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e91afdc3-21f1-4ecb-be14-20005df22e8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:27.356277 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e91afdc3-21f1-4ecb-be14-20005df22e8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:27.357141 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e91afdc3-21f1-4ecb-be14-20005df22e8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:27.365459 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e91afdc3-21f1-4ecb-be14-20005df22e8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:27.370846 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e91afdc3-21f1-4ecb-be14-20005df22e8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:27.483713 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-da2e54c7-aae2-4388-a876-11ce64e079d1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:27.526606 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-da2e54c7-aae2-4388-a876-11ce64e079d1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1276 microversion: 2.1 time: 1.116816 Nov 24 16:05:27.565608 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 20/32] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:26 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1276 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:27.577763 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-472f3267-b179-4caa-8398-e86e58ba75c2 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:27.579611 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-472f3267-b179-4caa-8398-e86e58ba75c2 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:27.620585 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-472f3267-b179-4caa-8398-e86e58ba75c2 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:27.630481 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-472f3267-b179-4caa-8398-e86e58ba75c2 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:27.631703 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-472f3267-b179-4caa-8398-e86e58ba75c2 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:27.632366 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-472f3267-b179-4caa-8398-e86e58ba75c2 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:28.152495 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-472f3267-b179-4caa-8398-e86e58ba75c2 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:28.178268 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-472f3267-b179-4caa-8398-e86e58ba75c2 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1271 microversion: 2.1 time: 0.603546 Nov 24 16:05:28.192318 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 21/33] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:27 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1271 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:28.266094 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e91afdc3-21f1-4ecb-be14-20005df22e8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:28.294991 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e91afdc3-21f1-4ecb-be14-20005df22e8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:28.314742 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e91afdc3-21f1-4ecb-be14-20005df22e8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:28.319564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e91afdc3-21f1-4ecb-be14-20005df22e8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1333 microversion: 2.20 time: 1.039681 Nov 24 16:05:28.326007 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 13/34] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:27 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1333 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:05:28.569108 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-806437b8-8b10-403a-b0bc-fb80babfa261 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:28.572833 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-806437b8-8b10-403a-b0bc-fb80babfa261 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:28.631979 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-806437b8-8b10-403a-b0bc-fb80babfa261 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:28.632901 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-806437b8-8b10-403a-b0bc-fb80babfa261 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:28.637081 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-806437b8-8b10-403a-b0bc-fb80babfa261 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:28.638101 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-806437b8-8b10-403a-b0bc-fb80babfa261 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:29.023737 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-806437b8-8b10-403a-b0bc-fb80babfa261 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:29.036717 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-806437b8-8b10-403a-b0bc-fb80babfa261 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1276 microversion: 2.1 time: 0.479903 Nov 24 16:05:29.040554 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 22/35] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:28 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1276 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:29.198014 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-81ad5b0d-100f-4390-8c4d-a53f28d4e292 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:29.199013 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-81ad5b0d-100f-4390-8c4d-a53f28d4e292 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:29.210645 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-81ad5b0d-100f-4390-8c4d-a53f28d4e292 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:29.211261 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-81ad5b0d-100f-4390-8c4d-a53f28d4e292 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:29.212175 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-81ad5b0d-100f-4390-8c4d-a53f28d4e292 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:29.219435 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-81ad5b0d-100f-4390-8c4d-a53f28d4e292 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:29.356911 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b8ec2c03-8a5d-45ed-90f7-97a9cb2ce237 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:29.360356 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b8ec2c03-8a5d-45ed-90f7-97a9cb2ce237 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:29.401015 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b8ec2c03-8a5d-45ed-90f7-97a9cb2ce237 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:29.404192 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b8ec2c03-8a5d-45ed-90f7-97a9cb2ce237 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:29.410558 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b8ec2c03-8a5d-45ed-90f7-97a9cb2ce237 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:29.412764 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b8ec2c03-8a5d-45ed-90f7-97a9cb2ce237 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:29.615814 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-81ad5b0d-100f-4390-8c4d-a53f28d4e292 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:29.677972 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-81ad5b0d-100f-4390-8c4d-a53f28d4e292 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1271 microversion: 2.1 time: 0.479570 Nov 24 16:05:29.708962 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 14/36] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:29 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1271 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:30.056208 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b6c07b52-3171-4091-8e8d-93e1b5e48d33 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:30.057987 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b6c07b52-3171-4091-8e8d-93e1b5e48d33 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:30.070296 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b6c07b52-3171-4091-8e8d-93e1b5e48d33 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:30.073414 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b6c07b52-3171-4091-8e8d-93e1b5e48d33 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:30.074621 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b6c07b52-3171-4091-8e8d-93e1b5e48d33 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:30.075462 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b6c07b52-3171-4091-8e8d-93e1b5e48d33 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:30.101473 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b8ec2c03-8a5d-45ed-90f7-97a9cb2ce237 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:30.120799 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b8ec2c03-8a5d-45ed-90f7-97a9cb2ce237 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:30.134200 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b8ec2c03-8a5d-45ed-90f7-97a9cb2ce237 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:30.138828 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b8ec2c03-8a5d-45ed-90f7-97a9cb2ce237 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1339 microversion: 2.20 time: 0.793613 Nov 24 16:05:30.151487 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 23/37] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:29 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1339 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:05:31.028470 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b6c07b52-3171-4091-8e8d-93e1b5e48d33 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:31.082548 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b6c07b52-3171-4091-8e8d-93e1b5e48d33 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 1.023082 Nov 24 16:05:31.086210 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 15/38] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:30 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:05:31.121504 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3b34f6cc-f5ed-40e2-bd6a-98673ed93457 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:31.122797 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3b34f6cc-f5ed-40e2-bd6a-98673ed93457 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:31.126897 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7f763492-a337-40f6-9af7-d7c5c503fbb4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'create', calling method: .version_select at 0x7f361ae28820>, body: {"keypair": {"name": "tempest-keypair-643994653"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:31.155319 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3b34f6cc-f5ed-40e2-bd6a-98673ed93457 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:31.160623 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3b34f6cc-f5ed-40e2-bd6a-98673ed93457 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:31.162665 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3b34f6cc-f5ed-40e2-bd6a-98673ed93457 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:31.167595 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3b34f6cc-f5ed-40e2-bd6a-98673ed93457 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:31.184137 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-7f763492-a337-40f6-9af7-d7c5c503fbb4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Getting quotas for project 1c341b845ae6468b847beba4eee796dd. Resources: {'key_pairs'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:05:31.194617 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-7f763492-a337-40f6-9af7-d7c5c503fbb4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Getting quotas for user 6d57401cbd6048c8b02c727520df44e9 and project 1c341b845ae6468b847beba4eee796dd. Resources: {'key_pairs'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:05:31.753848 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-7f763492-a337-40f6-9af7-d7c5c503fbb4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Getting quotas for project 1c341b845ae6468b847beba4eee796dd. Resources: {'key_pairs'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:05:31.774594 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-7f763492-a337-40f6-9af7-d7c5c503fbb4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Getting quotas for user 6d57401cbd6048c8b02c727520df44e9 and project 1c341b845ae6468b847beba4eee796dd. Resources: {'key_pairs'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:05:31.828125 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7f763492-a337-40f6-9af7-d7c5c503fbb4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.215505 Nov 24 16:05:31.832793 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 24/39] 10.222.0.72 () {60 vars in 1157 bytes} [Wed Nov 24 16:05:30 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:31.851511 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c7c32834-3373-4b4c-a7d3-c7f7766e4971 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:31.852909 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c7c32834-3373-4b4c-a7d3-c7f7766e4971 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:31.872932 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c7c32834-3373-4b4c-a7d3-c7f7766e4971 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:31.874488 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c7c32834-3373-4b4c-a7d3-c7f7766e4971 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:31.874943 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c7c32834-3373-4b4c-a7d3-c7f7766e4971 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:31.875473 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c7c32834-3373-4b4c-a7d3-c7f7766e4971 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:32.376729 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3b34f6cc-f5ed-40e2-bd6a-98673ed93457 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:32.421383 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3b34f6cc-f5ed-40e2-bd6a-98673ed93457 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1271 microversion: 2.1 time: 1.321970 Nov 24 16:05:32.423757 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 16/40] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:31 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1271 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:32.458047 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6327470a-cb9b-4d54-ab28-e81bf4db10bd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:32.459539 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6327470a-cb9b-4d54-ab28-e81bf4db10bd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:32.486775 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6327470a-cb9b-4d54-ab28-e81bf4db10bd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:32.488367 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6327470a-cb9b-4d54-ab28-e81bf4db10bd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:32.493594 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6327470a-cb9b-4d54-ab28-e81bf4db10bd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:32.512090 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6327470a-cb9b-4d54-ab28-e81bf4db10bd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:32.964208 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c7c32834-3373-4b4c-a7d3-c7f7766e4971 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:32.981557 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c7c32834-3373-4b4c-a7d3-c7f7766e4971 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:33.007476 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c7c32834-3373-4b4c-a7d3-c7f7766e4971 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:33.008923 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c7c32834-3373-4b4c-a7d3-c7f7766e4971 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1339 microversion: 2.20 time: 1.174521 Nov 24 16:05:33.016764 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 25/41] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:31 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1339 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:05:33.343932 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6327470a-cb9b-4d54-ab28-e81bf4db10bd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:33.356042 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6327470a-cb9b-4d54-ab28-e81bf4db10bd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.926084 Nov 24 16:05:33.372700 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 17/42] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:32 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:33.456560 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-85af4447-4573-4bc0-8f07-efee70142461 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:33.459640 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-85af4447-4573-4bc0-8f07-efee70142461 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:33.493746 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-85af4447-4573-4bc0-8f07-efee70142461 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:33.494560 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-85af4447-4573-4bc0-8f07-efee70142461 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:33.498096 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-85af4447-4573-4bc0-8f07-efee70142461 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:33.499291 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-85af4447-4573-4bc0-8f07-efee70142461 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:34.033889 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-71b5b9ff-2885-4cf5-b320-bafb6cffe304 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:34.034948 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-71b5b9ff-2885-4cf5-b320-bafb6cffe304 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:34.046930 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-71b5b9ff-2885-4cf5-b320-bafb6cffe304 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:34.047398 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-71b5b9ff-2885-4cf5-b320-bafb6cffe304 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:34.054940 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-71b5b9ff-2885-4cf5-b320-bafb6cffe304 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:34.055455 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-71b5b9ff-2885-4cf5-b320-bafb6cffe304 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:34.468204 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-71b5b9ff-2885-4cf5-b320-bafb6cffe304 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:34.484863 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-71b5b9ff-2885-4cf5-b320-bafb6cffe304 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:34.492627 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-71b5b9ff-2885-4cf5-b320-bafb6cffe304 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:34.498865 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-71b5b9ff-2885-4cf5-b320-bafb6cffe304 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1339 microversion: 2.20 time: 0.468285 Nov 24 16:05:34.501376 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 18/43] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:34 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1339 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:05:34.524162 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-120ae9ea-de93-4456-93c2-fd682b6d68c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:34.524794 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-120ae9ea-de93-4456-93c2-fd682b6d68c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:34.547349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-120ae9ea-de93-4456-93c2-fd682b6d68c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:34.547805 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-120ae9ea-de93-4456-93c2-fd682b6d68c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:34.548782 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-120ae9ea-de93-4456-93c2-fd682b6d68c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:34.549272 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-120ae9ea-de93-4456-93c2-fd682b6d68c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:35.106373 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-85af4447-4573-4bc0-8f07-efee70142461 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:35.138535 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-85af4447-4573-4bc0-8f07-efee70142461 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1271 microversion: 2.1 time: 1.690017 Nov 24 16:05:35.144287 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 26/44] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:33 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1271 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:35.155818 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-120ae9ea-de93-4456-93c2-fd682b6d68c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:35.194992 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-120ae9ea-de93-4456-93c2-fd682b6d68c1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.690953 Nov 24 16:05:35.197165 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 19/45] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:34 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:35.457011 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-fdd1c330-0536-448f-aa29-03ef4833390e req-05c44402-f5d1-4ef2-8b38-103651069d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e069fb-95d8-4964-b82d-ca884fcb2b5e", "tag": "691eb29c-951c-4f72-b283-76d5f14e961e"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:35.461617 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:05:35.461617 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:05:35.478021 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-fdd1c330-0536-448f-aa29-03ef4833390e req-05c44402-f5d1-4ef2-8b38-103651069d63 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:35.478866 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-fdd1c330-0536-448f-aa29-03ef4833390e req-05c44402-f5d1-4ef2-8b38-103651069d63 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:35.526442 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8440026f-e04b-42d8-b575-16f9776eff9c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:35.527520 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8440026f-e04b-42d8-b575-16f9776eff9c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:35.564199 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8440026f-e04b-42d8-b575-16f9776eff9c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:35.564720 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8440026f-e04b-42d8-b575-16f9776eff9c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:35.565580 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8440026f-e04b-42d8-b575-16f9776eff9c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:35.566024 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8440026f-e04b-42d8-b575-16f9776eff9c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:35.579883 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-fdd1c330-0536-448f-aa29-03ef4833390e req-05c44402-f5d1-4ef2-8b38-103651069d63 service nova] Creating event network-changed:691eb29c-951c-4f72-b283-76d5f14e961e for instance c7e069fb-95d8-4964-b82d-ca884fcb2b5e on hv-cinder-81899 Nov 24 16:05:35.581301 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-fdd1c330-0536-448f-aa29-03ef4833390e req-05c44402-f5d1-4ef2-8b38-103651069d63 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 24 16:05:35.583485 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5d5364b2-72f2-4da9-b507-0bed77e90a69 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:35.584488 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5d5364b2-72f2-4da9-b507-0bed77e90a69 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:35.602353 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5d5364b2-72f2-4da9-b507-0bed77e90a69 None None] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:35.603178 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5d5364b2-72f2-4da9-b507-0bed77e90a69 None None] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:35.685820 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.compute.rpcapi [None req-5d5364b2-72f2-4da9-b507-0bed77e90a69 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 24 16:05:35.700056 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5d5364b2-72f2-4da9-b507-0bed77e90a69 None None] Releasing lock "compute-rpcapi-router" {{(pid=116303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 24 16:05:35.853455 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5d5364b2-72f2-4da9-b507-0bed77e90a69 None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.495426 Nov 24 16:05:35.859183 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 27/46] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:05:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:05:35.860421 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8440026f-e04b-42d8-b575-16f9776eff9c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:35.872191 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8440026f-e04b-42d8-b575-16f9776eff9c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:35.877746 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8440026f-e04b-42d8-b575-16f9776eff9c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:35.884955 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8440026f-e04b-42d8-b575-16f9776eff9c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1339 microversion: 2.20 time: 0.369470 Nov 24 16:05:35.902818 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 20/47] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:35 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1339 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:05:36.184564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2f5683ea-8f02-4b32-a7d5-1f427d614cb3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:36.194679 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2f5683ea-8f02-4b32-a7d5-1f427d614cb3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:36.219871 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f5683ea-8f02-4b32-a7d5-1f427d614cb3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:36.220342 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f5683ea-8f02-4b32-a7d5-1f427d614cb3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:36.224295 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f5683ea-8f02-4b32-a7d5-1f427d614cb3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:36.225685 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2f5683ea-8f02-4b32-a7d5-1f427d614cb3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:36.647340 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2f5683ea-8f02-4b32-a7d5-1f427d614cb3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:36.667725 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2f5683ea-8f02-4b32-a7d5-1f427d614cb3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.495184 Nov 24 16:05:36.678653 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 21/48] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:36 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:36.695168 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-976289461", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df42b516-6753-481b-a21c-74d7dd325e73"}]}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:36.698305 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0280a342-0676-471c-9d19-a4d662d6e186 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:36.700226 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0280a342-0676-471c-9d19-a4d662d6e186 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:36.726100 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0280a342-0676-471c-9d19-a4d662d6e186 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:36.726538 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0280a342-0676-471c-9d19-a4d662d6e186 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:36.735952 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0280a342-0676-471c-9d19-a4d662d6e186 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:36.736618 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0280a342-0676-471c-9d19-a4d662d6e186 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:36.927727 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.network.neutron [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] validate_networks() for [('df42b516-6753-481b-a21c-74d7dd325e73', None, None, None, None, None)] {{(pid=116303) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:05:37.322319 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0280a342-0676-471c-9d19-a4d662d6e186 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:37.358522 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0280a342-0676-471c-9d19-a4d662d6e186 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.679484 Nov 24 16:05:37.360404 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 22/49] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:36 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:37.414584 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d5da073b-66a6-44cb-a1ad-073a7a3b7f02 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:37.415673 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d5da073b-66a6-44cb-a1ad-073a7a3b7f02 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:37.463631 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d5da073b-66a6-44cb-a1ad-073a7a3b7f02 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:37.464413 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d5da073b-66a6-44cb-a1ad-073a7a3b7f02 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:37.465888 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d5da073b-66a6-44cb-a1ad-073a7a3b7f02 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:37.466645 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d5da073b-66a6-44cb-a1ad-073a7a3b7f02 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:38.067760 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d5da073b-66a6-44cb-a1ad-073a7a3b7f02 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:38.084886 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d5da073b-66a6-44cb-a1ad-073a7a3b7f02 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:38.093540 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d5da073b-66a6-44cb-a1ad-073a7a3b7f02 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:38.099409 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d5da073b-66a6-44cb-a1ad-073a7a3b7f02 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.732361 Nov 24 16:05:38.102580 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 23/50] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:37 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:05:38.148822 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-faed51b9-df9e-494b-9de7-b95802df1076 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:38.153068 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-faed51b9-df9e-494b-9de7-b95802df1076 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:38.167520 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-faed51b9-df9e-494b-9de7-b95802df1076 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:38.172269 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-faed51b9-df9e-494b-9de7-b95802df1076 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:38.176714 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-faed51b9-df9e-494b-9de7-b95802df1076 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:38.178039 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-faed51b9-df9e-494b-9de7-b95802df1076 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:38.370310 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Flavor limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:05:38.371558 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Image limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:05:38.372215 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Flavor pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:05:38.372804 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Image pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:05:38.374121 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:05:38.395707 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:38.396617 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:38.399012 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:38.400961 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:38.450087 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Getting quotas for project 60b309e35e734edbaf96c844838de867. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:05:38.477323 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Getting quotas for user cadde7b294fa4dd784a9d55df7ba4a6b and project 60b309e35e734edbaf96c844838de867. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:05:38.491911 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Going to run 1 instances... {{(pid=116303) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:05:38.494751 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:05:38.559651 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-980c526a-cac1-4f01-aed0-21e100aa4a6b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.399701 Nov 24 16:05:38.561114 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 28/51] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:05:36 2021] POST /compute/v2.1/servers => generated 383 bytes in 2403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:05:38.567070 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-871e1bda-a231-46b2-995f-300c7f17343e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:38.568395 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-871e1bda-a231-46b2-995f-300c7f17343e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:38.579651 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-871e1bda-a231-46b2-995f-300c7f17343e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:38.580406 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-871e1bda-a231-46b2-995f-300c7f17343e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:38.581479 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-871e1bda-a231-46b2-995f-300c7f17343e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:38.582166 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-871e1bda-a231-46b2-995f-300c7f17343e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:38.815000 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-871e1bda-a231-46b2-995f-300c7f17343e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:38.824342 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-871e1bda-a231-46b2-995f-300c7f17343e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.261683 Nov 24 16:05:38.827465 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 29/52] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:38 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:38.832551 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e64d047b-433f-4c67-b3f6-e27ac2f64c73 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:38.833551 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e64d047b-433f-4c67-b3f6-e27ac2f64c73 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:38.916333 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-faed51b9-df9e-494b-9de7-b95802df1076 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:38.940429 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-faed51b9-df9e-494b-9de7-b95802df1076 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.833232 Nov 24 16:05:38.946636 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 24/53] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:38 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:38.990236 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e64d047b-433f-4c67-b3f6-e27ac2f64c73 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:38.999756 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e64d047b-433f-4c67-b3f6-e27ac2f64c73 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1221 microversion: 2.1 time: 0.170916 Nov 24 16:05:39.001419 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 30/54] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:38 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:39.112687 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1706618151", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df42b516-6753-481b-a21c-74d7dd325e73"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:39.126704 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-81d38fd7-af6e-4bfa-b080-8bde4a132fc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:39.128188 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-81d38fd7-af6e-4bfa-b080-8bde4a132fc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:39.136538 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-81d38fd7-af6e-4bfa-b080-8bde4a132fc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:39.137601 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-81d38fd7-af6e-4bfa-b080-8bde4a132fc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:39.144420 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-81d38fd7-af6e-4bfa-b080-8bde4a132fc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:39.145148 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-81d38fd7-af6e-4bfa-b080-8bde4a132fc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:39.272976 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] validate_networks() for [('df42b516-6753-481b-a21c-74d7dd325e73', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:05:39.521172 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-81d38fd7-af6e-4bfa-b080-8bde4a132fc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:39.534451 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-81d38fd7-af6e-4bfa-b080-8bde4a132fc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:39.536843 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-81d38fd7-af6e-4bfa-b080-8bde4a132fc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:39.561146 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-81d38fd7-af6e-4bfa-b080-8bde4a132fc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.439280 Nov 24 16:05:39.569497 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 31/55] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:39 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:05:39.821963 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-209653489", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d785b693-1522-4c61-9c47-37993ec7d517"}], "security_groups": [{"name": "tempest-securitygroup--722220740"}], "key_name": "tempest-keypair-643994653", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:40.183650 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.network.neutron [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] validate_networks() for [('d785b693-1522-4c61-9c47-37993ec7d517', None, None, None, None, None)] {{(pid=116303) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:05:41.232186 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Flavor limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:05:41.233826 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Image limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:05:41.234851 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Flavor pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:05:41.235699 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Image pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:05:41.236541 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:05:41.274549 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:41.275547 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:41.276792 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:41.277829 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:41.364386 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Getting quotas for project 1c341b845ae6468b847beba4eee796dd. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:05:41.393647 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Getting quotas for user 6d57401cbd6048c8b02c727520df44e9 and project 1c341b845ae6468b847beba4eee796dd. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:05:41.442627 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Going to run 1 instances... {{(pid=116303) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:05:41.453768 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:05:41.483298 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:05:41.484323 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:05:41.485603 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:05:41.486526 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:05:41.487538 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:05:41.605629 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:41.606105 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:41.629801 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:41.633195 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:41.688148 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8c1c9e6e-4b03-45ce-8afe-87706d69c820 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.870204 Nov 24 16:05:41.690181 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 32/56] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:05:39 2021] POST /compute/v2.1/servers => generated 401 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 16:05:41.703061 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-220e547e-f997-46cd-a20e-5ba10c8b442a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:41.704216 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-220e547e-f997-46cd-a20e-5ba10c8b442a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:41.714917 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-220e547e-f997-46cd-a20e-5ba10c8b442a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:41.715943 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-220e547e-f997-46cd-a20e-5ba10c8b442a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:41.717488 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-220e547e-f997-46cd-a20e-5ba10c8b442a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:41.718174 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-220e547e-f997-46cd-a20e-5ba10c8b442a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:41.757415 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Getting quotas for project 60b309e35e734edbaf96c844838de867. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:05:41.770345 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Getting quotas for user cadde7b294fa4dd784a9d55df7ba4a6b and project 60b309e35e734edbaf96c844838de867. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:05:41.804068 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:05:41.807362 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:05:41.911660 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-18e1338c-f9ca-4638-b750-f9e78224b585 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.802320 Nov 24 16:05:41.914806 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 25/57] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:05:39 2021] POST /compute/v2.1/servers => generated 383 bytes in 2808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:05:41.928756 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2e09b15a-3564-4637-84ee-df7bc36f9cff tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:41.929814 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2e09b15a-3564-4637-84ee-df7bc36f9cff tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:41.965772 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e09b15a-3564-4637-84ee-df7bc36f9cff tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:41.968789 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e09b15a-3564-4637-84ee-df7bc36f9cff tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:41.969880 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e09b15a-3564-4637-84ee-df7bc36f9cff tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:41.974149 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e09b15a-3564-4637-84ee-df7bc36f9cff tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:42.826816 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2e09b15a-3564-4637-84ee-df7bc36f9cff tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:42.835424 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2e09b15a-3564-4637-84ee-df7bc36f9cff tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.919034 Nov 24 16:05:42.836033 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 26/58] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:41 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:42.866910 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c8c4a9d2-ce8b-4887-90f9-334b75c7656c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:42.867542 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c8c4a9d2-ce8b-4887-90f9-334b75c7656c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:42.888827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8c4a9d2-ce8b-4887-90f9-334b75c7656c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:42.910980 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8c4a9d2-ce8b-4887-90f9-334b75c7656c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:42.912033 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8c4a9d2-ce8b-4887-90f9-334b75c7656c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:42.913549 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8c4a9d2-ce8b-4887-90f9-334b75c7656c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:43.318746 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-220e547e-f997-46cd-a20e-5ba10c8b442a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:43.330320 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-220e547e-f997-46cd-a20e-5ba10c8b442a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 1.637927 Nov 24 16:05:43.334126 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 33/59] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:41 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:43.345514 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-bfcc84a6-c135-4d5c-a567-63d0810597de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:43.349847 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-bfcc84a6-c135-4d5c-a567-63d0810597de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:43.361113 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bfcc84a6-c135-4d5c-a567-63d0810597de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:43.370763 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bfcc84a6-c135-4d5c-a567-63d0810597de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:43.372167 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bfcc84a6-c135-4d5c-a567-63d0810597de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:43.374055 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bfcc84a6-c135-4d5c-a567-63d0810597de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:43.691199 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c8c4a9d2-ce8b-4887-90f9-334b75c7656c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:43.721229 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c8c4a9d2-ce8b-4887-90f9-334b75c7656c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:43.725969 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c8c4a9d2-ce8b-4887-90f9-334b75c7656c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:43.727267 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c8c4a9d2-ce8b-4887-90f9-334b75c7656c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.890186 Nov 24 16:05:43.727700 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 27/60] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:42 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:05:43.737859 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-22b7010a-4765-423e-aba9-ef4c6e6e010d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:43.753774 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-22b7010a-4765-423e-aba9-ef4c6e6e010d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:43.771192 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-22b7010a-4765-423e-aba9-ef4c6e6e010d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:43.772056 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-22b7010a-4765-423e-aba9-ef4c6e6e010d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:43.775583 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-22b7010a-4765-423e-aba9-ef4c6e6e010d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:43.778549 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-22b7010a-4765-423e-aba9-ef4c6e6e010d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:43.817737 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-bfcc84a6-c135-4d5c-a567-63d0810597de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:43.827397 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-bfcc84a6-c135-4d5c-a567-63d0810597de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1232 microversion: 2.1 time: 0.488343 Nov 24 16:05:43.830727 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 34/61] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:43 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1232 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:43.865338 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6613f960-a177-42c1-a2ce-664f7508dbb6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:43.867148 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6613f960-a177-42c1-a2ce-664f7508dbb6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:43.882402 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6613f960-a177-42c1-a2ce-664f7508dbb6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:43.883089 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6613f960-a177-42c1-a2ce-664f7508dbb6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:43.884396 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6613f960-a177-42c1-a2ce-664f7508dbb6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:43.884949 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6613f960-a177-42c1-a2ce-664f7508dbb6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:43.924873 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-22b7010a-4765-423e-aba9-ef4c6e6e010d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:43.936922 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-22b7010a-4765-423e-aba9-ef4c6e6e010d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1218 microversion: 2.1 time: 0.201334 Nov 24 16:05:43.939182 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 28/62] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:43 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1218 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:44.374229 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c9c71c2a-7279-473a-bbaf-c3d40ba1cc7c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:44.375559 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c9c71c2a-7279-473a-bbaf-c3d40ba1cc7c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:44.389588 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c9c71c2a-7279-473a-bbaf-c3d40ba1cc7c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:44.390881 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c9c71c2a-7279-473a-bbaf-c3d40ba1cc7c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:44.392609 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c9c71c2a-7279-473a-bbaf-c3d40ba1cc7c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:44.393563 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c9c71c2a-7279-473a-bbaf-c3d40ba1cc7c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:44.411925 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6613f960-a177-42c1-a2ce-664f7508dbb6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:44.423550 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6613f960-a177-42c1-a2ce-664f7508dbb6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.562415 Nov 24 16:05:44.446720 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 35/63] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:43 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:44.613237 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c9c71c2a-7279-473a-bbaf-c3d40ba1cc7c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:44.621206 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c9c71c2a-7279-473a-bbaf-c3d40ba1cc7c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.257305 Nov 24 16:05:44.622010 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 29/64] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:44 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:44.756778 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-04892861-3789-40b6-9236-5c301fd0b315 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:44.757570 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-04892861-3789-40b6-9236-5c301fd0b315 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:44.765088 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-04892861-3789-40b6-9236-5c301fd0b315 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:44.765925 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-04892861-3789-40b6-9236-5c301fd0b315 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:44.767149 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-04892861-3789-40b6-9236-5c301fd0b315 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:44.767841 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-04892861-3789-40b6-9236-5c301fd0b315 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:44.847634 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6e8910a6-c1cd-40ea-b737-9e566c122334 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:44.849003 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6e8910a6-c1cd-40ea-b737-9e566c122334 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:44.859713 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6e8910a6-c1cd-40ea-b737-9e566c122334 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:44.860587 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6e8910a6-c1cd-40ea-b737-9e566c122334 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:44.862165 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6e8910a6-c1cd-40ea-b737-9e566c122334 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:44.862873 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6e8910a6-c1cd-40ea-b737-9e566c122334 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:45.043960 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6e8910a6-c1cd-40ea-b737-9e566c122334 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:45.055700 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6e8910a6-c1cd-40ea-b737-9e566c122334 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1288 microversion: 2.1 time: 0.212768 Nov 24 16:05:45.077373 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 30/65] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:44 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1288 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:05:45.087306 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-086a9303-d9cd-4ecd-91bd-9b7959a48d8a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:45.092105 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-086a9303-d9cd-4ecd-91bd-9b7959a48d8a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:45.110234 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-086a9303-d9cd-4ecd-91bd-9b7959a48d8a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:45.111181 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-086a9303-d9cd-4ecd-91bd-9b7959a48d8a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:45.112353 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-086a9303-d9cd-4ecd-91bd-9b7959a48d8a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:45.117566 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-086a9303-d9cd-4ecd-91bd-9b7959a48d8a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:45.369102 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-086a9303-d9cd-4ecd-91bd-9b7959a48d8a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:45.380666 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-086a9303-d9cd-4ecd-91bd-9b7959a48d8a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1218 microversion: 2.1 time: 0.301841 Nov 24 16:05:45.382733 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 31/66] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:45 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1218 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:45.416105 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-04892861-3789-40b6-9236-5c301fd0b315 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:45.437449 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-04892861-3789-40b6-9236-5c301fd0b315 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:45.439584 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-04892861-3789-40b6-9236-5c301fd0b315 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:45.441452 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-04892861-3789-40b6-9236-5c301fd0b315 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.689473 Nov 24 16:05:45.444788 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 36/67] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:44 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:05:45.461809 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5416e730-990d-4757-b68b-4822bf4dc108 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:45.462930 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5416e730-990d-4757-b68b-4822bf4dc108 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:45.473995 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5416e730-990d-4757-b68b-4822bf4dc108 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:45.478048 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5416e730-990d-4757-b68b-4822bf4dc108 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:45.480273 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5416e730-990d-4757-b68b-4822bf4dc108 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:45.494208 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5416e730-990d-4757-b68b-4822bf4dc108 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:45.649270 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f698d98d-f7d0-4697-96d2-d0b251cd8e7a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:45.650402 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f698d98d-f7d0-4697-96d2-d0b251cd8e7a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:45.661252 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f698d98d-f7d0-4697-96d2-d0b251cd8e7a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:45.662207 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f698d98d-f7d0-4697-96d2-d0b251cd8e7a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:45.663599 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f698d98d-f7d0-4697-96d2-d0b251cd8e7a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:45.664383 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f698d98d-f7d0-4697-96d2-d0b251cd8e7a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:46.683455 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5416e730-990d-4757-b68b-4822bf4dc108 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:46.707989 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-f698d98d-f7d0-4697-96d2-d0b251cd8e7a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:46.744019 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f698d98d-f7d0-4697-96d2-d0b251cd8e7a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 1.108751 Nov 24 16:05:46.744583 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5416e730-990d-4757-b68b-4822bf4dc108 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 1.286778 Nov 24 16:05:46.745235 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 32/68] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:45 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:46.754384 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 37/69] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:45 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:05:46.771461 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-40197e2e-ff53-43de-b1b5-e2fc8c85ca45 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:46.772196 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-40197e2e-ff53-43de-b1b5-e2fc8c85ca45 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:46.783980 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-40197e2e-ff53-43de-b1b5-e2fc8c85ca45 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:46.784520 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-40197e2e-ff53-43de-b1b5-e2fc8c85ca45 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:46.785743 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-40197e2e-ff53-43de-b1b5-e2fc8c85ca45 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:46.797015 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-40197e2e-ff53-43de-b1b5-e2fc8c85ca45 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:46.975865 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-1ab2d0df-0cf2-4b29-9ecf-7590db9a8a90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4070b904-d207-48f3-b522-209d11d5291c", "tag": "af829109-ec6d-4b1f-b501-099d680019fe"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:46.981289 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:05:46.981289 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:05:46.996323 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-1ab2d0df-0cf2-4b29-9ecf-7590db9a8a90 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:46.998659 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-1ab2d0df-0cf2-4b29-9ecf-7590db9a8a90 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:47.038261 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-1ab2d0df-0cf2-4b29-9ecf-7590db9a8a90 service nova] Creating event network-changed:af829109-ec6d-4b1f-b501-099d680019fe for instance 4070b904-d207-48f3-b522-209d11d5291c on hv-cinder-81899 Nov 24 16:05:47.049242 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-52a95548-2bc3-4ded-84d0-c998a4766e48 req-1ab2d0df-0cf2-4b29-9ecf-7590db9a8a90 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287536 Nov 24 16:05:47.051157 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 38/70] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:05:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:05:47.064883 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f62adfd4-f93f-4829-9a3d-8296751b0495 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:47.067319 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f62adfd4-f93f-4829-9a3d-8296751b0495 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:47.082076 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f62adfd4-f93f-4829-9a3d-8296751b0495 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:47.085545 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f62adfd4-f93f-4829-9a3d-8296751b0495 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:47.086676 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f62adfd4-f93f-4829-9a3d-8296751b0495 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:47.088415 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f62adfd4-f93f-4829-9a3d-8296751b0495 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:47.259564 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-f62adfd4-f93f-4829-9a3d-8296751b0495 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:47.267169 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-40197e2e-ff53-43de-b1b5-e2fc8c85ca45 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:47.267444 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f62adfd4-f93f-4829-9a3d-8296751b0495 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1280 microversion: 2.1 time: 0.214848 Nov 24 16:05:47.273833 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 39/71] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:47 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1280 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:47.280291 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5170efab-fa06-4b07-ba54-d7882b932ebf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:47.282922 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-40197e2e-ff53-43de-b1b5-e2fc8c85ca45 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1294 microversion: 2.1 time: 0.536433 Nov 24 16:05:47.284128 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 33/72] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:46 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1294 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:47.297754 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5170efab-fa06-4b07-ba54-d7882b932ebf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:47.323585 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5170efab-fa06-4b07-ba54-d7882b932ebf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:47.325465 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5170efab-fa06-4b07-ba54-d7882b932ebf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:47.326994 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5170efab-fa06-4b07-ba54-d7882b932ebf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:47.327858 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5170efab-fa06-4b07-ba54-d7882b932ebf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:47.773070 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d0124571-d319-4930-8c5e-60654eee6486 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:47.774352 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d0124571-d319-4930-8c5e-60654eee6486 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:47.789801 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d0124571-d319-4930-8c5e-60654eee6486 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:47.790644 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d0124571-d319-4930-8c5e-60654eee6486 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:47.792242 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d0124571-d319-4930-8c5e-60654eee6486 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:47.792887 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d0124571-d319-4930-8c5e-60654eee6486 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:48.138319 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-5170efab-fa06-4b07-ba54-d7882b932ebf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:48.223982 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-5170efab-fa06-4b07-ba54-d7882b932ebf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:48.236767 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-5170efab-fa06-4b07-ba54-d7882b932ebf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:48.245384 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5170efab-fa06-4b07-ba54-d7882b932ebf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.968229 Nov 24 16:05:48.249527 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d0124571-d319-4930-8c5e-60654eee6486 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:48.249967 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 40/73] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:47 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:05:48.271341 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7ca9a824-18ef-4c7a-b689-f7b7434c2fa8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:48.276188 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7ca9a824-18ef-4c7a-b689-f7b7434c2fa8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:48.295728 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d0124571-d319-4930-8c5e-60654eee6486 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.525221 Nov 24 16:05:48.297938 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 34/74] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:47 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:05:48.306191 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7ca9a824-18ef-4c7a-b689-f7b7434c2fa8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:48.307503 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7ca9a824-18ef-4c7a-b689-f7b7434c2fa8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:48.311783 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7ca9a824-18ef-4c7a-b689-f7b7434c2fa8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:48.313422 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7ca9a824-18ef-4c7a-b689-f7b7434c2fa8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:48.327270 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3d2a13f8-49d9-4d6a-ae41-f206d8034246 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:48.332010 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3d2a13f8-49d9-4d6a-ae41-f206d8034246 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:48.346645 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3d2a13f8-49d9-4d6a-ae41-f206d8034246 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:48.346645 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3d2a13f8-49d9-4d6a-ae41-f206d8034246 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:48.347100 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3d2a13f8-49d9-4d6a-ae41-f206d8034246 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:48.352823 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3d2a13f8-49d9-4d6a-ae41-f206d8034246 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:48.864200 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3d2a13f8-49d9-4d6a-ae41-f206d8034246 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:48.872420 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3d2a13f8-49d9-4d6a-ae41-f206d8034246 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.567459 Nov 24 16:05:48.889557 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 35/75] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:48 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:48.889557 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8ce3a5b6-569d-494e-b075-c73c8a240526 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:48.889557 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8ce3a5b6-569d-494e-b075-c73c8a240526 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:48.891423 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ce3a5b6-569d-494e-b075-c73c8a240526 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:48.891879 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ce3a5b6-569d-494e-b075-c73c8a240526 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:48.892880 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ce3a5b6-569d-494e-b075-c73c8a240526 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:48.893500 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ce3a5b6-569d-494e-b075-c73c8a240526 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:48.984600 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7ca9a824-18ef-4c7a-b689-f7b7434c2fa8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:48.993987 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7ca9a824-18ef-4c7a-b689-f7b7434c2fa8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.739864 Nov 24 16:05:49.005308 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 41/76] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:48 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:49.093152 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-35232e85-7176-4963-8307-3cf7fcd89eca req-1589737a-5a70-466f-9782-e3bd1eb728ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:49.097138 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:05:49.097138 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:05:49.112721 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-35232e85-7176-4963-8307-3cf7fcd89eca req-1589737a-5a70-466f-9782-e3bd1eb728ea service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:49.115013 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-35232e85-7176-4963-8307-3cf7fcd89eca req-1589737a-5a70-466f-9782-e3bd1eb728ea service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:49.145366 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-35232e85-7176-4963-8307-3cf7fcd89eca req-1589737a-5a70-466f-9782-e3bd1eb728ea service nova] Creating event network-changed:0cc6f513-6305-463b-bb1d-17ec8928f67c for instance 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 on hv-cinder-81899 Nov 24 16:05:49.159395 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-35232e85-7176-4963-8307-3cf7fcd89eca req-1589737a-5a70-466f-9782-e3bd1eb728ea service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077178 Nov 24 16:05:49.160969 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 42/77] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:05:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:05:49.276582 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-07da9b5b-e434-4658-b557-fe545f8889f3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:49.282917 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-07da9b5b-e434-4658-b557-fe545f8889f3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:49.301289 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-07da9b5b-e434-4658-b557-fe545f8889f3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:49.302884 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-07da9b5b-e434-4658-b557-fe545f8889f3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:49.305166 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-07da9b5b-e434-4658-b557-fe545f8889f3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:49.305924 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-07da9b5b-e434-4658-b557-fe545f8889f3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:49.647378 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8ce3a5b6-569d-494e-b075-c73c8a240526 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:49.674937 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8ce3a5b6-569d-494e-b075-c73c8a240526 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.794138 Nov 24 16:05:49.693560 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 36/78] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:48 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:49.713288 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2d476565-0053-4668-8a70-5a6148bef0dd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:49.714952 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2d476565-0053-4668-8a70-5a6148bef0dd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:49.723949 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2d476565-0053-4668-8a70-5a6148bef0dd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:49.724709 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2d476565-0053-4668-8a70-5a6148bef0dd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:49.726027 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2d476565-0053-4668-8a70-5a6148bef0dd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:49.726680 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2d476565-0053-4668-8a70-5a6148bef0dd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:50.026683 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-07da9b5b-e434-4658-b557-fe545f8889f3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:50.038197 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-07da9b5b-e434-4658-b557-fe545f8889f3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:50.039865 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-07da9b5b-e434-4658-b557-fe545f8889f3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:50.041072 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-07da9b5b-e434-4658-b557-fe545f8889f3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.775005 Nov 24 16:05:50.060416 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 43/79] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:49 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:05:50.069864 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-566d1f77-fcc2-4b75-b95e-baaf21b7deb7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:50.070387 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-566d1f77-fcc2-4b75-b95e-baaf21b7deb7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:50.098463 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-566d1f77-fcc2-4b75-b95e-baaf21b7deb7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:50.099278 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-566d1f77-fcc2-4b75-b95e-baaf21b7deb7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:50.100834 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-566d1f77-fcc2-4b75-b95e-baaf21b7deb7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:50.101523 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-566d1f77-fcc2-4b75-b95e-baaf21b7deb7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:50.226052 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2d476565-0053-4668-8a70-5a6148bef0dd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:50.242931 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2d476565-0053-4668-8a70-5a6148bef0dd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.547733 Nov 24 16:05:50.243625 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 37/80] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:49 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:50.260968 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-76db936f-958c-4ff2-b0f2-8e7fa8d1aa8a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:50.261229 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-76db936f-958c-4ff2-b0f2-8e7fa8d1aa8a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:50.282315 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-76db936f-958c-4ff2-b0f2-8e7fa8d1aa8a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:50.282755 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-76db936f-958c-4ff2-b0f2-8e7fa8d1aa8a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:50.285014 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-76db936f-958c-4ff2-b0f2-8e7fa8d1aa8a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:50.288536 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-76db936f-958c-4ff2-b0f2-8e7fa8d1aa8a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:50.788728 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-566d1f77-fcc2-4b75-b95e-baaf21b7deb7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:50.801273 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-566d1f77-fcc2-4b75-b95e-baaf21b7deb7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.734970 Nov 24 16:05:50.802370 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 44/81] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:50 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:50.829624 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-8d7970e8-c43a-4d57-baf0-3034d0fc15a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f67d55-afc9-4ce8-a9c5-8256298c4b7e", "tag": "1c836e44-a6b1-400d-a64b-3d1e5a65fd29"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:50.831816 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:05:50.831816 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:05:50.854289 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-8d7970e8-c43a-4d57-baf0-3034d0fc15a1 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:50.857660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-8d7970e8-c43a-4d57-baf0-3034d0fc15a1 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:50.926524 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-8d7970e8-c43a-4d57-baf0-3034d0fc15a1 service nova] Creating event network-changed:1c836e44-a6b1-400d-a64b-3d1e5a65fd29 for instance 80f67d55-afc9-4ce8-a9c5-8256298c4b7e on hv-cinder-81899 Nov 24 16:05:50.941849 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-fa9478d7-7666-481d-9362-da95c35c7e51 req-8d7970e8-c43a-4d57-baf0-3034d0fc15a1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129344 Nov 24 16:05:50.942509 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 45/82] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:05:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:05:50.969258 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5cc1635e-f7ef-4be7-9bfa-1f215ac1e831 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:50.970630 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5cc1635e-f7ef-4be7-9bfa-1f215ac1e831 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:50.985298 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5cc1635e-f7ef-4be7-9bfa-1f215ac1e831 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:50.986209 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5cc1635e-f7ef-4be7-9bfa-1f215ac1e831 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:50.987971 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5cc1635e-f7ef-4be7-9bfa-1f215ac1e831 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:50.988643 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5cc1635e-f7ef-4be7-9bfa-1f215ac1e831 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:51.244176 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-76db936f-958c-4ff2-b0f2-8e7fa8d1aa8a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:51.273280 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-76db936f-958c-4ff2-b0f2-8e7fa8d1aa8a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 1.027441 Nov 24 16:05:51.286350 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 38/83] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:50 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:51.302341 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-feeedcb9-c515-4f35-ab68-d5c93f3dfcd1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:51.307238 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-feeedcb9-c515-4f35-ab68-d5c93f3dfcd1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:51.316225 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-feeedcb9-c515-4f35-ab68-d5c93f3dfcd1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:51.317226 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-feeedcb9-c515-4f35-ab68-d5c93f3dfcd1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:51.318563 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-feeedcb9-c515-4f35-ab68-d5c93f3dfcd1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:51.319467 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-feeedcb9-c515-4f35-ab68-d5c93f3dfcd1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:51.676359 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-5cc1635e-f7ef-4be7-9bfa-1f215ac1e831 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:51.686927 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5cc1635e-f7ef-4be7-9bfa-1f215ac1e831 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.741557 Nov 24 16:05:51.698462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 46/84] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:50 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:51.704525 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-f41ac5d2-1ea4-4c10-8d0c-888def2093c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3a9b563-1f54-4c61-923f-9b557a3c307b", "tag": "533d257a-8aad-4722-8f01-84015f80cdd5"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:51.706685 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:05:51.706685 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:05:51.716443 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-f41ac5d2-1ea4-4c10-8d0c-888def2093c9 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:51.717576 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-f41ac5d2-1ea4-4c10-8d0c-888def2093c9 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:51.734764 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-f41ac5d2-1ea4-4c10-8d0c-888def2093c9 service nova] Creating event network-changed:533d257a-8aad-4722-8f01-84015f80cdd5 for instance a3a9b563-1f54-4c61-923f-9b557a3c307b on hv-cinder-81899 Nov 24 16:05:51.740350 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-e4d94d5f-1f40-45c4-8fce-bacdcbe36c0f req-f41ac5d2-1ea4-4c10-8d0c-888def2093c9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040290 Nov 24 16:05:51.741542 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-feeedcb9-c515-4f35-ab68-d5c93f3dfcd1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:51.741810 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 47/85] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:05:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:05:51.747263 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3271fd49-c7e6-454c-8af3-d52a160d5123 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:51.749145 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3271fd49-c7e6-454c-8af3-d52a160d5123 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:51.756491 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3271fd49-c7e6-454c-8af3-d52a160d5123 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:51.757347 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3271fd49-c7e6-454c-8af3-d52a160d5123 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:51.758848 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3271fd49-c7e6-454c-8af3-d52a160d5123 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:51.760035 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3271fd49-c7e6-454c-8af3-d52a160d5123 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:51.772501 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-feeedcb9-c515-4f35-ab68-d5c93f3dfcd1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:51.788176 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-feeedcb9-c515-4f35-ab68-d5c93f3dfcd1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:51.796827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-feeedcb9-c515-4f35-ab68-d5c93f3dfcd1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.506120 Nov 24 16:05:51.798246 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 39/86] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:51 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:05:51.832377 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c5b97226-f39f-4791-9980-6e21eed4645c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:51.839238 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c5b97226-f39f-4791-9980-6e21eed4645c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:51.867305 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5b97226-f39f-4791-9980-6e21eed4645c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:51.869116 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5b97226-f39f-4791-9980-6e21eed4645c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:51.871283 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5b97226-f39f-4791-9980-6e21eed4645c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:51.871943 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5b97226-f39f-4791-9980-6e21eed4645c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:52.107550 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3271fd49-c7e6-454c-8af3-d52a160d5123 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:52.117613 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3271fd49-c7e6-454c-8af3-d52a160d5123 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.374398 Nov 24 16:05:52.118456 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 48/87] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:51 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:52.303212 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-966e4b12-b24f-4ba9-bbd3-73ef4a29637e tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:52.304108 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-966e4b12-b24f-4ba9-bbd3-73ef4a29637e tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:52.310860 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-966e4b12-b24f-4ba9-bbd3-73ef4a29637e tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:52.312385 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-966e4b12-b24f-4ba9-bbd3-73ef4a29637e tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:52.313525 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-966e4b12-b24f-4ba9-bbd3-73ef4a29637e tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:52.315125 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-966e4b12-b24f-4ba9-bbd3-73ef4a29637e tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:52.318192 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c5b97226-f39f-4791-9980-6e21eed4645c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:52.326897 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c5b97226-f39f-4791-9980-6e21eed4645c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.510266 Nov 24 16:05:52.332076 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 40/88] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:51 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:52.632427 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-966e4b12-b24f-4ba9-bbd3-73ef4a29637e tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:52.643432 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-966e4b12-b24f-4ba9-bbd3-73ef4a29637e tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.345749 Nov 24 16:05:52.649132 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 49/89] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:52 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:05:52.706477 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-19319a3c-742d-471d-9645-07dbc4db61f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:52.707529 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-19319a3c-742d-471d-9645-07dbc4db61f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:52.721619 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19319a3c-742d-471d-9645-07dbc4db61f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:52.722778 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19319a3c-742d-471d-9645-07dbc4db61f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:52.723926 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19319a3c-742d-471d-9645-07dbc4db61f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:52.724733 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19319a3c-742d-471d-9645-07dbc4db61f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:52.816172 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a09841a4-fbdc-4c1d-a76d-68d4480a40fa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:52.816792 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a09841a4-fbdc-4c1d-a76d-68d4480a40fa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:52.863144 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a09841a4-fbdc-4c1d-a76d-68d4480a40fa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:52.864351 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a09841a4-fbdc-4c1d-a76d-68d4480a40fa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:52.865473 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a09841a4-fbdc-4c1d-a76d-68d4480a40fa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:52.866247 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a09841a4-fbdc-4c1d-a76d-68d4480a40fa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:53.044122 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a09841a4-fbdc-4c1d-a76d-68d4480a40fa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:53.054307 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a09841a4-fbdc-4c1d-a76d-68d4480a40fa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:53.057169 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a09841a4-fbdc-4c1d-a76d-68d4480a40fa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:53.059749 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a09841a4-fbdc-4c1d-a76d-68d4480a40fa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.247187 Nov 24 16:05:53.063047 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 50/90] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:52 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:05:53.071366 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-806565ad-a361-4e5f-86e2-38da762062c5 req-21691a9a-5dd2-4da6-96a1-afbd530f77c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f50ef3-7864-4548-8230-12ddb5ef83a0", "tag": "a424f220-1812-4f50-ab01-68a1923ec96d"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:53.075000 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:05:53.075000 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:05:53.092824 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-806565ad-a361-4e5f-86e2-38da762062c5 req-21691a9a-5dd2-4da6-96a1-afbd530f77c6 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:53.093298 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-806565ad-a361-4e5f-86e2-38da762062c5 req-21691a9a-5dd2-4da6-96a1-afbd530f77c6 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:53.116321 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-806565ad-a361-4e5f-86e2-38da762062c5 req-21691a9a-5dd2-4da6-96a1-afbd530f77c6 service nova] Creating event network-changed:a424f220-1812-4f50-ab01-68a1923ec96d for instance 32f50ef3-7864-4548-8230-12ddb5ef83a0 on hv-cinder-81899 Nov 24 16:05:53.124858 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-806565ad-a361-4e5f-86e2-38da762062c5 req-21691a9a-5dd2-4da6-96a1-afbd530f77c6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059585 Nov 24 16:05:53.126301 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 51/91] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:05:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:05:53.130509 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-19319a3c-742d-471d-9645-07dbc4db61f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:53.138755 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fb0f2f7e-adec-4fb3-a4c1-9853904b1d1e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:53.140054 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fb0f2f7e-adec-4fb3-a4c1-9853904b1d1e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:53.153322 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fb0f2f7e-adec-4fb3-a4c1-9853904b1d1e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:53.154147 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fb0f2f7e-adec-4fb3-a4c1-9853904b1d1e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:53.156762 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fb0f2f7e-adec-4fb3-a4c1-9853904b1d1e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:53.157727 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fb0f2f7e-adec-4fb3-a4c1-9853904b1d1e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:53.175474 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-19319a3c-742d-471d-9645-07dbc4db61f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.474634 Nov 24 16:05:53.183753 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 41/92] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:52 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:53.367676 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9e1e7fca-aebc-4d8d-8ce0-91848f3d1ef7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:53.368368 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9e1e7fca-aebc-4d8d-8ce0-91848f3d1ef7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:53.399449 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9e1e7fca-aebc-4d8d-8ce0-91848f3d1ef7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:53.401204 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9e1e7fca-aebc-4d8d-8ce0-91848f3d1ef7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:53.405466 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9e1e7fca-aebc-4d8d-8ce0-91848f3d1ef7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:53.410737 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9e1e7fca-aebc-4d8d-8ce0-91848f3d1ef7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:53.625980 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-fb0f2f7e-adec-4fb3-a4c1-9853904b1d1e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:53.652550 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fb0f2f7e-adec-4fb3-a4c1-9853904b1d1e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.512747 Nov 24 16:05:53.669828 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 52/93] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:53 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:53.690557 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3023778a-36b2-4756-bf6c-10b943260a27 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:53.690695 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9e1e7fca-aebc-4d8d-8ce0-91848f3d1ef7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:53.691244 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3023778a-36b2-4756-bf6c-10b943260a27 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:53.704348 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9e1e7fca-aebc-4d8d-8ce0-91848f3d1ef7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.344625 Nov 24 16:05:53.705470 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 42/94] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:53 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:05:53.722876 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3023778a-36b2-4756-bf6c-10b943260a27 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:53.723778 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3023778a-36b2-4756-bf6c-10b943260a27 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:53.725280 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3023778a-36b2-4756-bf6c-10b943260a27 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:53.726064 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3023778a-36b2-4756-bf6c-10b943260a27 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:54.047789 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3023778a-36b2-4756-bf6c-10b943260a27 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:54.056524 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3023778a-36b2-4756-bf6c-10b943260a27 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.385117 Nov 24 16:05:54.067800 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 53/95] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:53 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:54.079976 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c2418f89-c494-4677-9f21-4d39b1a1cda6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:54.080916 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c2418f89-c494-4677-9f21-4d39b1a1cda6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:54.087709 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c2418f89-c494-4677-9f21-4d39b1a1cda6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:54.088157 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c2418f89-c494-4677-9f21-4d39b1a1cda6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:54.089216 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c2418f89-c494-4677-9f21-4d39b1a1cda6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:54.089837 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c2418f89-c494-4677-9f21-4d39b1a1cda6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:54.206669 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d3834391-875d-425d-b852-7b55bd518491 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:54.207314 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d3834391-875d-425d-b852-7b55bd518491 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:54.213408 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d3834391-875d-425d-b852-7b55bd518491 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:54.213987 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d3834391-875d-425d-b852-7b55bd518491 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:54.215148 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d3834391-875d-425d-b852-7b55bd518491 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:54.215484 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d3834391-875d-425d-b852-7b55bd518491 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:54.266010 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c2418f89-c494-4677-9f21-4d39b1a1cda6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:54.274836 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c2418f89-c494-4677-9f21-4d39b1a1cda6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:54.276344 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c2418f89-c494-4677-9f21-4d39b1a1cda6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:54.285758 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c2418f89-c494-4677-9f21-4d39b1a1cda6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.202165 Nov 24 16:05:54.297844 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 43/96] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:54 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:05:54.386128 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d3834391-875d-425d-b852-7b55bd518491 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:54.393618 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d3834391-875d-425d-b852-7b55bd518491 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.191113 Nov 24 16:05:54.394197 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 54/97] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:54 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:54.685719 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-69317f6d-0152-494e-a03a-d8780ce9ef04 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:54.687116 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-69317f6d-0152-494e-a03a-d8780ce9ef04 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:54.699022 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69317f6d-0152-494e-a03a-d8780ce9ef04 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:54.699987 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69317f6d-0152-494e-a03a-d8780ce9ef04 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:54.704360 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69317f6d-0152-494e-a03a-d8780ce9ef04 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:54.705242 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69317f6d-0152-494e-a03a-d8780ce9ef04 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:54.723649 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a1cd058d-15ca-4343-9a88-44029e224965 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:54.724241 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a1cd058d-15ca-4343-9a88-44029e224965 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:54.732957 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a1cd058d-15ca-4343-9a88-44029e224965 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:54.734010 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a1cd058d-15ca-4343-9a88-44029e224965 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:54.735367 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a1cd058d-15ca-4343-9a88-44029e224965 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:54.736004 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a1cd058d-15ca-4343-9a88-44029e224965 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:54.923623 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-69317f6d-0152-494e-a03a-d8780ce9ef04 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:54.935911 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-69317f6d-0152-494e-a03a-d8780ce9ef04 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.257128 Nov 24 16:05:54.937280 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 44/98] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:54 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:55.023544 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a1cd058d-15ca-4343-9a88-44029e224965 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:55.038794 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a1cd058d-15ca-4343-9a88-44029e224965 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.318022 Nov 24 16:05:55.040249 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 55/99] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:54 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:05:55.075221 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8bfd83eb-0c56-46c6-b6b7-f1cf157dd4f1 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:55.076643 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8bfd83eb-0c56-46c6-b6b7-f1cf157dd4f1 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:55.083984 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8bfd83eb-0c56-46c6-b6b7-f1cf157dd4f1 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:55.084799 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8bfd83eb-0c56-46c6-b6b7-f1cf157dd4f1 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:55.086092 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8bfd83eb-0c56-46c6-b6b7-f1cf157dd4f1 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:55.086772 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8bfd83eb-0c56-46c6-b6b7-f1cf157dd4f1 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:55.307445 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fffb6d30-bd9d-45b5-815c-c02972466cf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:55.310744 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fffb6d30-bd9d-45b5-815c-c02972466cf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:55.320476 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fffb6d30-bd9d-45b5-815c-c02972466cf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:55.321180 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fffb6d30-bd9d-45b5-815c-c02972466cf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:55.322435 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fffb6d30-bd9d-45b5-815c-c02972466cf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:55.323026 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fffb6d30-bd9d-45b5-815c-c02972466cf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:55.353077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8bfd83eb-0c56-46c6-b6b7-f1cf157dd4f1 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:55.369465 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8bfd83eb-0c56-46c6-b6b7-f1cf157dd4f1 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.297848 Nov 24 16:05:55.370748 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 45/100] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:55 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:55.412957 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dcce511a-4335-4665-b34f-e5651861666b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:55.413896 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dcce511a-4335-4665-b34f-e5651861666b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:55.420941 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dcce511a-4335-4665-b34f-e5651861666b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:55.421650 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dcce511a-4335-4665-b34f-e5651861666b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:55.423537 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dcce511a-4335-4665-b34f-e5651861666b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:55.424144 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dcce511a-4335-4665-b34f-e5651861666b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:55.494092 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-fffb6d30-bd9d-45b5-815c-c02972466cf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:55.504518 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-fffb6d30-bd9d-45b5-815c-c02972466cf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:55.506264 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-fffb6d30-bd9d-45b5-815c-c02972466cf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:55.507422 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fffb6d30-bd9d-45b5-815c-c02972466cf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.207014 Nov 24 16:05:55.508174 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 56/101] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:55 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:05:55.599977 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dcce511a-4335-4665-b34f-e5651861666b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:55.608311 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dcce511a-4335-4665-b34f-e5651861666b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.200954 Nov 24 16:05:55.608888 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 46/102] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:55 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:05:55.954401 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ecf4591f-b3c8-4bfd-8121-ee00b400a3d3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:55.955312 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ecf4591f-b3c8-4bfd-8121-ee00b400a3d3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:55.961632 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ecf4591f-b3c8-4bfd-8121-ee00b400a3d3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:55.962076 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ecf4591f-b3c8-4bfd-8121-ee00b400a3d3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:55.963055 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ecf4591f-b3c8-4bfd-8121-ee00b400a3d3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:55.963491 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ecf4591f-b3c8-4bfd-8121-ee00b400a3d3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:56.068600 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-78e85144-f21a-42e0-9c73-63ccb2c3f508 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:56.069254 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-78e85144-f21a-42e0-9c73-63ccb2c3f508 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:56.078152 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-78e85144-f21a-42e0-9c73-63ccb2c3f508 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:56.078683 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-78e85144-f21a-42e0-9c73-63ccb2c3f508 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:56.079520 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-78e85144-f21a-42e0-9c73-63ccb2c3f508 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:56.079961 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-78e85144-f21a-42e0-9c73-63ccb2c3f508 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:56.153570 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-ecf4591f-b3c8-4bfd-8121-ee00b400a3d3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:56.163384 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ecf4591f-b3c8-4bfd-8121-ee00b400a3d3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.213267 Nov 24 16:05:56.164367 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 57/103] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:55 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:56.281268 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-78e85144-f21a-42e0-9c73-63ccb2c3f508 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:56.293691 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-78e85144-f21a-42e0-9c73-63ccb2c3f508 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.228536 Nov 24 16:05:56.295442 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 47/104] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:56 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:56.387499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-088bd9d9-6614-4c19-8a6a-e5578713e8f7 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:56.388207 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-088bd9d9-6614-4c19-8a6a-e5578713e8f7 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:56.394233 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-088bd9d9-6614-4c19-8a6a-e5578713e8f7 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:56.394827 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-088bd9d9-6614-4c19-8a6a-e5578713e8f7 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:56.395769 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-088bd9d9-6614-4c19-8a6a-e5578713e8f7 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:56.396299 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-088bd9d9-6614-4c19-8a6a-e5578713e8f7 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:56.526349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-96394a55-59bd-4e17-adef-18e689c7331b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:56.527196 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-96394a55-59bd-4e17-adef-18e689c7331b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:56.533488 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96394a55-59bd-4e17-adef-18e689c7331b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:56.533936 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96394a55-59bd-4e17-adef-18e689c7331b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:56.534721 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96394a55-59bd-4e17-adef-18e689c7331b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:56.535144 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96394a55-59bd-4e17-adef-18e689c7331b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:56.553938 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-088bd9d9-6614-4c19-8a6a-e5578713e8f7 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:56.562592 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-088bd9d9-6614-4c19-8a6a-e5578713e8f7 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.178621 Nov 24 16:05:56.563295 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 58/105] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:56 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:56.625331 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-46b6b7c1-63bf-466e-9fe4-949db567a996 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:56.625917 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-46b6b7c1-63bf-466e-9fe4-949db567a996 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:56.632589 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-46b6b7c1-63bf-466e-9fe4-949db567a996 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:56.633340 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-46b6b7c1-63bf-466e-9fe4-949db567a996 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:56.634394 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-46b6b7c1-63bf-466e-9fe4-949db567a996 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:56.634987 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-46b6b7c1-63bf-466e-9fe4-949db567a996 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:56.692203 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-96394a55-59bd-4e17-adef-18e689c7331b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:56.706298 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-96394a55-59bd-4e17-adef-18e689c7331b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:56.706298 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-96394a55-59bd-4e17-adef-18e689c7331b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:56.707379 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-96394a55-59bd-4e17-adef-18e689c7331b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.184437 Nov 24 16:05:56.708766 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 48/106] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:56 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:05:56.800134 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-46b6b7c1-63bf-466e-9fe4-949db567a996 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:56.808326 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-46b6b7c1-63bf-466e-9fe4-949db567a996 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.187471 Nov 24 16:05:56.809007 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 59/107] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:56 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:57.190470 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c8f198dd-194a-46da-8e6b-a6c01d31c36e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:57.192305 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c8f198dd-194a-46da-8e6b-a6c01d31c36e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:57.199518 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8f198dd-194a-46da-8e6b-a6c01d31c36e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:57.199934 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8f198dd-194a-46da-8e6b-a6c01d31c36e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:57.201447 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8f198dd-194a-46da-8e6b-a6c01d31c36e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:57.202115 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8f198dd-194a-46da-8e6b-a6c01d31c36e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:57.320571 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4bba9562-a828-42c5-936f-5333c98c9259 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:57.322086 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4bba9562-a828-42c5-936f-5333c98c9259 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:57.333210 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4bba9562-a828-42c5-936f-5333c98c9259 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:57.333891 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4bba9562-a828-42c5-936f-5333c98c9259 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:57.335202 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4bba9562-a828-42c5-936f-5333c98c9259 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:57.335730 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4bba9562-a828-42c5-936f-5333c98c9259 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:57.438156 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c8f198dd-194a-46da-8e6b-a6c01d31c36e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:57.451260 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c8f198dd-194a-46da-8e6b-a6c01d31c36e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.264171 Nov 24 16:05:57.453607 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 49/108] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:57 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:05:57.589425 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4bba9562-a828-42c5-936f-5333c98c9259 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:57.599374 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-997e02e5-c353-467c-8cf2-bcaa77857d38 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:57.599609 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4bba9562-a828-42c5-936f-5333c98c9259 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.287481 Nov 24 16:05:57.600546 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-997e02e5-c353-467c-8cf2-bcaa77857d38 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:57.610585 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 60/109] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:57 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:57.618980 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-997e02e5-c353-467c-8cf2-bcaa77857d38 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:57.619845 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-997e02e5-c353-467c-8cf2-bcaa77857d38 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:57.622142 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-997e02e5-c353-467c-8cf2-bcaa77857d38 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:57.623732 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-997e02e5-c353-467c-8cf2-bcaa77857d38 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:57.727680 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-97a4f92a-67f3-4b35-b205-e8efcff95d1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:57.728531 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-97a4f92a-67f3-4b35-b205-e8efcff95d1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:57.735894 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-97a4f92a-67f3-4b35-b205-e8efcff95d1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:57.736350 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-97a4f92a-67f3-4b35-b205-e8efcff95d1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:57.746265 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-97a4f92a-67f3-4b35-b205-e8efcff95d1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:57.746869 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-97a4f92a-67f3-4b35-b205-e8efcff95d1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:57.810192 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-997e02e5-c353-467c-8cf2-bcaa77857d38 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:57.825454 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-997e02e5-c353-467c-8cf2-bcaa77857d38 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.236220 Nov 24 16:05:57.826868 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 50/110] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:57 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:57.834327 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a4147208-650e-4ff9-ae40-60e13a8097bc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:57.835398 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a4147208-650e-4ff9-ae40-60e13a8097bc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:57.852541 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4147208-650e-4ff9-ae40-60e13a8097bc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:57.856174 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4147208-650e-4ff9-ae40-60e13a8097bc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:57.857304 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4147208-650e-4ff9-ae40-60e13a8097bc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:57.859301 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4147208-650e-4ff9-ae40-60e13a8097bc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:57.996177 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-97a4f92a-67f3-4b35-b205-e8efcff95d1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:58.007951 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-97a4f92a-67f3-4b35-b205-e8efcff95d1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:58.010129 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-97a4f92a-67f3-4b35-b205-e8efcff95d1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:58.011671 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-97a4f92a-67f3-4b35-b205-e8efcff95d1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.289384 Nov 24 16:05:58.012846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 61/111] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:57 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:05:58.114978 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a4147208-650e-4ff9-ae40-60e13a8097bc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:58.133229 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a4147208-650e-4ff9-ae40-60e13a8097bc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.302177 Nov 24 16:05:58.145327 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 51/112] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:57 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:58.474789 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b8b76e44-b1a5-4975-aeff-46a27abcc1b7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:58.475910 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b8b76e44-b1a5-4975-aeff-46a27abcc1b7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:58.492992 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b8b76e44-b1a5-4975-aeff-46a27abcc1b7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:58.494296 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b8b76e44-b1a5-4975-aeff-46a27abcc1b7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:58.496306 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b8b76e44-b1a5-4975-aeff-46a27abcc1b7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:58.498025 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b8b76e44-b1a5-4975-aeff-46a27abcc1b7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:58.769350 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b8b76e44-b1a5-4975-aeff-46a27abcc1b7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:58.784651 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b8b76e44-b1a5-4975-aeff-46a27abcc1b7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.316171 Nov 24 16:05:58.787231 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 52/113] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:58 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:58.797073 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2b95b8a3-1bc4-4c68-9a3a-1646baeb13a8 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:58.798615 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2b95b8a3-1bc4-4c68-9a3a-1646baeb13a8 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:58.810436 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2b95b8a3-1bc4-4c68-9a3a-1646baeb13a8 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:58.811917 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2b95b8a3-1bc4-4c68-9a3a-1646baeb13a8 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:58.813772 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2b95b8a3-1bc4-4c68-9a3a-1646baeb13a8 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:58.815323 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2b95b8a3-1bc4-4c68-9a3a-1646baeb13a8 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:58.827398 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-2b536164-d89c-433d-a29f-05d5cfe82223 req-179a8a20-d931-42fb-9311-51b69549db29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-plugged", "status": "completed", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:05:58.830215 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:05:58.830215 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:05:58.848115 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-2b536164-d89c-433d-a29f-05d5cfe82223 req-179a8a20-d931-42fb-9311-51b69549db29 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:58.852305 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-2b536164-d89c-433d-a29f-05d5cfe82223 req-179a8a20-d931-42fb-9311-51b69549db29 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:58.884086 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-2b536164-d89c-433d-a29f-05d5cfe82223 req-179a8a20-d931-42fb-9311-51b69549db29 service nova] Creating event network-vif-plugged:0cc6f513-6305-463b-bb1d-17ec8928f67c for instance 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 on hv-cinder-81899 Nov 24 16:05:58.899198 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-2b536164-d89c-433d-a29f-05d5cfe82223 req-179a8a20-d931-42fb-9311-51b69549db29 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.520256 Nov 24 16:05:58.907066 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 62/114] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:05:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:05:58.919920 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e50d1a15-9930-4d4e-9ef0-41d838f9e2aa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:58.921276 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e50d1a15-9930-4d4e-9ef0-41d838f9e2aa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:58.931132 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e50d1a15-9930-4d4e-9ef0-41d838f9e2aa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:58.932266 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e50d1a15-9930-4d4e-9ef0-41d838f9e2aa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:58.933596 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e50d1a15-9930-4d4e-9ef0-41d838f9e2aa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:58.934663 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e50d1a15-9930-4d4e-9ef0-41d838f9e2aa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:59.234189 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2b95b8a3-1bc4-4c68-9a3a-1646baeb13a8 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:59.262618 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2b95b8a3-1bc4-4c68-9a3a-1646baeb13a8 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.471493 Nov 24 16:05:59.266984 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 53/115] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:58 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:59.286450 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e50d1a15-9930-4d4e-9ef0-41d838f9e2aa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:59.292418 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-84eed7d1-837b-4c53-ab1d-86d1e1a5ad60 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:59.295242 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-84eed7d1-837b-4c53-ab1d-86d1e1a5ad60 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:59.303934 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e50d1a15-9930-4d4e-9ef0-41d838f9e2aa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.394639 Nov 24 16:05:59.304935 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-84eed7d1-837b-4c53-ab1d-86d1e1a5ad60 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:59.305766 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-84eed7d1-837b-4c53-ab1d-86d1e1a5ad60 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:59.306853 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-84eed7d1-837b-4c53-ab1d-86d1e1a5ad60 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:59.307514 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-84eed7d1-837b-4c53-ab1d-86d1e1a5ad60 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:59.311597 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 63/116] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:58 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:59.332730 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-50c45113-a82e-45df-9840-7f3fa8b1b14e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:59.335439 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-50c45113-a82e-45df-9840-7f3fa8b1b14e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:59.353539 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-50c45113-a82e-45df-9840-7f3fa8b1b14e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:59.356226 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-50c45113-a82e-45df-9840-7f3fa8b1b14e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:59.357801 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-50c45113-a82e-45df-9840-7f3fa8b1b14e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:59.358901 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-50c45113-a82e-45df-9840-7f3fa8b1b14e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:59.522390 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-84eed7d1-837b-4c53-ab1d-86d1e1a5ad60 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:59.533302 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-84eed7d1-837b-4c53-ab1d-86d1e1a5ad60 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:59.535616 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-84eed7d1-837b-4c53-ab1d-86d1e1a5ad60 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:59.538184 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-84eed7d1-837b-4c53-ab1d-86d1e1a5ad60 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.268937 Nov 24 16:05:59.539014 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 54/117] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:05:59 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:05:59.617383 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-50c45113-a82e-45df-9840-7f3fa8b1b14e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:05:59.632862 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-50c45113-a82e-45df-9840-7f3fa8b1b14e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.319388 Nov 24 16:05:59.633449 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 64/118] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:59 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:05:59.804488 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-96a32b1e-8236-4a36-80c9-d48c609d73c0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:05:59.805117 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-96a32b1e-8236-4a36-80c9-d48c609d73c0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:05:59.811783 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96a32b1e-8236-4a36-80c9-d48c609d73c0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:59.812504 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96a32b1e-8236-4a36-80c9-d48c609d73c0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:59.813508 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96a32b1e-8236-4a36-80c9-d48c609d73c0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:05:59.814275 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96a32b1e-8236-4a36-80c9-d48c609d73c0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:05:59.996355 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-96a32b1e-8236-4a36-80c9-d48c609d73c0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:00.007304 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-96a32b1e-8236-4a36-80c9-d48c609d73c0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.205680 Nov 24 16:06:00.008696 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 55/119] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:05:59 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:00.284964 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2d08135d-e787-4be9-b5af-899b58208616 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:00.286210 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2d08135d-e787-4be9-b5af-899b58208616 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:00.298579 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2d08135d-e787-4be9-b5af-899b58208616 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:00.300128 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2d08135d-e787-4be9-b5af-899b58208616 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:00.301620 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2d08135d-e787-4be9-b5af-899b58208616 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:00.302763 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2d08135d-e787-4be9-b5af-899b58208616 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:00.330036 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-023d7f59-8f62-4113-9a4f-0e6cc3d75380 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:00.330652 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-023d7f59-8f62-4113-9a4f-0e6cc3d75380 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:00.338438 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-023d7f59-8f62-4113-9a4f-0e6cc3d75380 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:00.338885 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-023d7f59-8f62-4113-9a4f-0e6cc3d75380 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:00.343019 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-023d7f59-8f62-4113-9a4f-0e6cc3d75380 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:00.343548 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-023d7f59-8f62-4113-9a4f-0e6cc3d75380 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:00.548541 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-2d08135d-e787-4be9-b5af-899b58208616 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:00.561239 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2d08135d-e787-4be9-b5af-899b58208616 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.279994 Nov 24 16:06:00.563241 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 65/120] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:00 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:00.570634 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-88607e7a-524a-4c52-ade6-7ee77e2ff231 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:00.575651 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-88607e7a-524a-4c52-ade6-7ee77e2ff231 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:00.588443 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88607e7a-524a-4c52-ade6-7ee77e2ff231 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:00.591106 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88607e7a-524a-4c52-ade6-7ee77e2ff231 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:00.592703 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88607e7a-524a-4c52-ade6-7ee77e2ff231 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:00.593755 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88607e7a-524a-4c52-ade6-7ee77e2ff231 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:00.624838 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-023d7f59-8f62-4113-9a4f-0e6cc3d75380 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:00.637510 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-023d7f59-8f62-4113-9a4f-0e6cc3d75380 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.313454 Nov 24 16:06:00.639573 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 56/121] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:00 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:00.655397 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-08b26e37-7d04-4f1e-9acf-b041208d0e4e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:00.656225 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-08b26e37-7d04-4f1e-9acf-b041208d0e4e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:00.668215 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-08b26e37-7d04-4f1e-9acf-b041208d0e4e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:00.668722 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-08b26e37-7d04-4f1e-9acf-b041208d0e4e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:00.670179 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-08b26e37-7d04-4f1e-9acf-b041208d0e4e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:00.670616 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-08b26e37-7d04-4f1e-9acf-b041208d0e4e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:00.815669 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-88607e7a-524a-4c52-ade6-7ee77e2ff231 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:00.824627 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-88607e7a-524a-4c52-ade6-7ee77e2ff231 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:00.826875 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-88607e7a-524a-4c52-ade6-7ee77e2ff231 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:00.828157 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-88607e7a-524a-4c52-ade6-7ee77e2ff231 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.263638 Nov 24 16:06:00.828844 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 66/122] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:06:00 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:06:00.846817 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-08b26e37-7d04-4f1e-9acf-b041208d0e4e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:00.856376 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-08b26e37-7d04-4f1e-9acf-b041208d0e4e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.208542 Nov 24 16:06:00.865119 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 57/123] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:00 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:00.927980 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-facc1911-4960-4ecc-b519-86478eb92a58 req-0c9d5e57-86d8-468a-8e78-9a0d1d4d7894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e069fb-95d8-4964-b82d-ca884fcb2b5e", "name": "network-vif-plugged", "status": "completed", "tag": "691eb29c-951c-4f72-b283-76d5f14e961e"}, {"server_uuid": "4070b904-d207-48f3-b522-209d11d5291c", "name": "network-vif-plugged", "status": "completed", "tag": "af829109-ec6d-4b1f-b501-099d680019fe"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:00.929722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:06:00.929722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:06:00.942760 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-facc1911-4960-4ecc-b519-86478eb92a58 req-0c9d5e57-86d8-468a-8e78-9a0d1d4d7894 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:00.943498 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-facc1911-4960-4ecc-b519-86478eb92a58 req-0c9d5e57-86d8-468a-8e78-9a0d1d4d7894 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:00.969436 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-facc1911-4960-4ecc-b519-86478eb92a58 req-0c9d5e57-86d8-468a-8e78-9a0d1d4d7894 service nova] Creating event network-vif-plugged:691eb29c-951c-4f72-b283-76d5f14e961e for instance c7e069fb-95d8-4964-b82d-ca884fcb2b5e on hv-cinder-81899 Nov 24 16:06:00.970384 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-facc1911-4960-4ecc-b519-86478eb92a58 req-0c9d5e57-86d8-468a-8e78-9a0d1d4d7894 service nova] Creating event network-vif-plugged:af829109-ec6d-4b1f-b501-099d680019fe for instance 4070b904-d207-48f3-b522-209d11d5291c on hv-cinder-81899 Nov 24 16:06:00.983709 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-facc1911-4960-4ecc-b519-86478eb92a58 req-0c9d5e57-86d8-468a-8e78-9a0d1d4d7894 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.058191 Nov 24 16:06:00.984765 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 67/124] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:06:00 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:06:01.026223 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c23a2782-b31b-4c53-bb92-1bc582139827 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:01.027086 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c23a2782-b31b-4c53-bb92-1bc582139827 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:01.033563 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c23a2782-b31b-4c53-bb92-1bc582139827 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:01.034012 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c23a2782-b31b-4c53-bb92-1bc582139827 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:01.034817 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c23a2782-b31b-4c53-bb92-1bc582139827 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:01.035324 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c23a2782-b31b-4c53-bb92-1bc582139827 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:01.195751 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c23a2782-b31b-4c53-bb92-1bc582139827 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:01.204933 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c23a2782-b31b-4c53-bb92-1bc582139827 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.182270 Nov 24 16:06:01.205553 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 58/125] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:01 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:01.647533 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3f55941f-9763-42a2-b97e-8c49ca692236 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:01.648309 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3f55941f-9763-42a2-b97e-8c49ca692236 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:01.656341 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f55941f-9763-42a2-b97e-8c49ca692236 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:01.656806 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f55941f-9763-42a2-b97e-8c49ca692236 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:01.657748 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f55941f-9763-42a2-b97e-8c49ca692236 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:01.658033 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f55941f-9763-42a2-b97e-8c49ca692236 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:01.659209 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-44f2f2ab-6646-44f6-b375-c0a482e7550b tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:01.660544 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-44f2f2ab-6646-44f6-b375-c0a482e7550b tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:01.675726 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44f2f2ab-6646-44f6-b375-c0a482e7550b tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:01.676307 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44f2f2ab-6646-44f6-b375-c0a482e7550b tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:01.677221 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44f2f2ab-6646-44f6-b375-c0a482e7550b tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:01.677672 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44f2f2ab-6646-44f6-b375-c0a482e7550b tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:01.843556 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3f55941f-9763-42a2-b97e-8c49ca692236 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:01.851654 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3f55941f-9763-42a2-b97e-8c49ca692236 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.208148 Nov 24 16:06:01.852244 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 68/126] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:01 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:01.857603 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c424dd26-caa3-4d16-8c92-3e18044d775b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:01.858443 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c424dd26-caa3-4d16-8c92-3e18044d775b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:01.860786 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-44f2f2ab-6646-44f6-b375-c0a482e7550b tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:01.865307 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c424dd26-caa3-4d16-8c92-3e18044d775b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:01.865878 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c424dd26-caa3-4d16-8c92-3e18044d775b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:01.866690 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c424dd26-caa3-4d16-8c92-3e18044d775b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:01.867124 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c424dd26-caa3-4d16-8c92-3e18044d775b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:01.874653 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-44f2f2ab-6646-44f6-b375-c0a482e7550b tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.222789 Nov 24 16:06:01.875455 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 59/127] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:01 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:01.882754 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4708f5a3-8ed5-4729-a6dd-14a22aed8ff5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:01.883709 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4708f5a3-8ed5-4729-a6dd-14a22aed8ff5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:01.892746 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4708f5a3-8ed5-4729-a6dd-14a22aed8ff5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:01.893392 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4708f5a3-8ed5-4729-a6dd-14a22aed8ff5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:01.894981 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4708f5a3-8ed5-4729-a6dd-14a22aed8ff5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:01.895873 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4708f5a3-8ed5-4729-a6dd-14a22aed8ff5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:02.052791 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4708f5a3-8ed5-4729-a6dd-14a22aed8ff5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:02.061168 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4708f5a3-8ed5-4729-a6dd-14a22aed8ff5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.183966 Nov 24 16:06:02.061760 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 60/128] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:01 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:02.082304 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c424dd26-caa3-4d16-8c92-3e18044d775b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:02.099897 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c424dd26-caa3-4d16-8c92-3e18044d775b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:02.099897 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c424dd26-caa3-4d16-8c92-3e18044d775b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:02.099897 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c424dd26-caa3-4d16-8c92-3e18044d775b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.245234 Nov 24 16:06:02.103760 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 69/129] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:06:01 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:06:02.222755 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1edaf8d6-9518-479b-ae62-169422043c6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:02.223501 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1edaf8d6-9518-479b-ae62-169422043c6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:02.229821 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1edaf8d6-9518-479b-ae62-169422043c6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:02.230260 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1edaf8d6-9518-479b-ae62-169422043c6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:02.231056 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1edaf8d6-9518-479b-ae62-169422043c6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:02.231614 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1edaf8d6-9518-479b-ae62-169422043c6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:02.384738 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1edaf8d6-9518-479b-ae62-169422043c6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:02.392886 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1edaf8d6-9518-479b-ae62-169422043c6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.173982 Nov 24 16:06:02.393506 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 61/130] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:02 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:02.872724 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-00d74b78-a282-4b07-9dc8-968e5878cde0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:02.873356 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-00d74b78-a282-4b07-9dc8-968e5878cde0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:02.879636 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-00d74b78-a282-4b07-9dc8-968e5878cde0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:02.880088 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-00d74b78-a282-4b07-9dc8-968e5878cde0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:02.880870 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-00d74b78-a282-4b07-9dc8-968e5878cde0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:02.881339 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-00d74b78-a282-4b07-9dc8-968e5878cde0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:02.899847 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6911712f-05ac-4a49-8d65-fe9ebd580bc4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:02.900552 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6911712f-05ac-4a49-8d65-fe9ebd580bc4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:02.906760 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6911712f-05ac-4a49-8d65-fe9ebd580bc4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:02.907211 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6911712f-05ac-4a49-8d65-fe9ebd580bc4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:02.908006 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6911712f-05ac-4a49-8d65-fe9ebd580bc4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:02.908445 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6911712f-05ac-4a49-8d65-fe9ebd580bc4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:03.056434 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6911712f-05ac-4a49-8d65-fe9ebd580bc4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:03.064944 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6911712f-05ac-4a49-8d65-fe9ebd580bc4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.169498 Nov 24 16:06:03.065647 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 62/131] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:02 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:03.066646 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-00d74b78-a282-4b07-9dc8-968e5878cde0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:03.074745 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-00d74b78-a282-4b07-9dc8-968e5878cde0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.206240 Nov 24 16:06:03.075348 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 70/132] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:02 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:03.091995 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1b852937-c3a8-49ec-8b1a-72550e1ad56a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:03.093130 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1b852937-c3a8-49ec-8b1a-72550e1ad56a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:03.100425 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1b852937-c3a8-49ec-8b1a-72550e1ad56a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:03.101160 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1b852937-c3a8-49ec-8b1a-72550e1ad56a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:03.102199 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1b852937-c3a8-49ec-8b1a-72550e1ad56a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:03.102771 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1b852937-c3a8-49ec-8b1a-72550e1ad56a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:03.124410 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-dec840b5-0f3b-41ea-b37b-bbeddf649d49 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:03.125239 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-dec840b5-0f3b-41ea-b37b-bbeddf649d49 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:03.131674 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dec840b5-0f3b-41ea-b37b-bbeddf649d49 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:03.132219 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dec840b5-0f3b-41ea-b37b-bbeddf649d49 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:03.133055 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dec840b5-0f3b-41ea-b37b-bbeddf649d49 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:03.133491 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dec840b5-0f3b-41ea-b37b-bbeddf649d49 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:03.287506 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1b852937-c3a8-49ec-8b1a-72550e1ad56a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:03.296452 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1b852937-c3a8-49ec-8b1a-72550e1ad56a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.211987 Nov 24 16:06:03.301766 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 63/133] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:03 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:03.313678 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-dec840b5-0f3b-41ea-b37b-bbeddf649d49 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:03.326239 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-dec840b5-0f3b-41ea-b37b-bbeddf649d49 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:03.328392 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-dec840b5-0f3b-41ea-b37b-bbeddf649d49 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:03.329571 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-dec840b5-0f3b-41ea-b37b-bbeddf649d49 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.209873 Nov 24 16:06:03.330603 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 71/134] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:06:03 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:06:03.410735 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-74833cd0-991a-49d6-8aff-819abd710dc0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:03.411337 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-74833cd0-991a-49d6-8aff-819abd710dc0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:03.418392 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-74833cd0-991a-49d6-8aff-819abd710dc0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:03.418884 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-74833cd0-991a-49d6-8aff-819abd710dc0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:03.419708 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-74833cd0-991a-49d6-8aff-819abd710dc0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:03.420226 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-74833cd0-991a-49d6-8aff-819abd710dc0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:03.558745 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-74833cd0-991a-49d6-8aff-819abd710dc0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:03.567232 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-74833cd0-991a-49d6-8aff-819abd710dc0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.160131 Nov 24 16:06:03.567729 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 64/135] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:03 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:04.082179 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-44e12ccd-bffd-4773-a6f3-d42b986327a8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:04.082741 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-44e12ccd-bffd-4773-a6f3-d42b986327a8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:04.090248 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-44e12ccd-bffd-4773-a6f3-d42b986327a8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:04.091237 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-44e12ccd-bffd-4773-a6f3-d42b986327a8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:04.092068 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-44e12ccd-bffd-4773-a6f3-d42b986327a8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:04.092500 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-44e12ccd-bffd-4773-a6f3-d42b986327a8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:04.094248 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-47bd6993-0273-43ac-86cd-678522f785d2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:04.094928 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-47bd6993-0273-43ac-86cd-678522f785d2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:04.102476 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-47bd6993-0273-43ac-86cd-678522f785d2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:04.102927 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-47bd6993-0273-43ac-86cd-678522f785d2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:04.103733 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-47bd6993-0273-43ac-86cd-678522f785d2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:04.104178 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-47bd6993-0273-43ac-86cd-678522f785d2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:04.250506 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-44e12ccd-bffd-4773-a6f3-d42b986327a8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:04.266370 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-44e12ccd-bffd-4773-a6f3-d42b986327a8 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.187183 Nov 24 16:06:04.267860 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 72/136] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:04 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:04.277463 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-47bd6993-0273-43ac-86cd-678522f785d2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:04.288671 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-47bd6993-0273-43ac-86cd-678522f785d2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.199931 Nov 24 16:06:04.289573 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 65/137] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:04 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:04.314915 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9bb6b7cc-3018-4098-9a4a-86a4c1725b7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:04.315564 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9bb6b7cc-3018-4098-9a4a-86a4c1725b7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:04.322035 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9bb6b7cc-3018-4098-9a4a-86a4c1725b7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:04.322509 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9bb6b7cc-3018-4098-9a4a-86a4c1725b7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:04.323317 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9bb6b7cc-3018-4098-9a4a-86a4c1725b7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:04.323751 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9bb6b7cc-3018-4098-9a4a-86a4c1725b7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:04.349953 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7df7c71e-b1c3-49cd-a008-c7d3e1c778fc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:04.351276 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7df7c71e-b1c3-49cd-a008-c7d3e1c778fc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:04.362182 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7df7c71e-b1c3-49cd-a008-c7d3e1c778fc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:04.362977 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7df7c71e-b1c3-49cd-a008-c7d3e1c778fc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:04.364340 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7df7c71e-b1c3-49cd-a008-c7d3e1c778fc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:04.365211 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7df7c71e-b1c3-49cd-a008-c7d3e1c778fc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:04.487110 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9bb6b7cc-3018-4098-9a4a-86a4c1725b7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:04.496185 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9bb6b7cc-3018-4098-9a4a-86a4c1725b7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.184986 Nov 24 16:06:04.496923 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 73/138] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:04 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:04.576190 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7df7c71e-b1c3-49cd-a008-c7d3e1c778fc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:04.584781 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a066066f-7452-461f-a33d-b08251b4f576 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:04.585186 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7df7c71e-b1c3-49cd-a008-c7d3e1c778fc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:04.590346 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a066066f-7452-461f-a33d-b08251b4f576 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:04.591111 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7df7c71e-b1c3-49cd-a008-c7d3e1c778fc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:04.591111 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7df7c71e-b1c3-49cd-a008-c7d3e1c778fc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.243602 Nov 24 16:06:04.591111 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 66/139] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:06:04 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:06:04.592906 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a066066f-7452-461f-a33d-b08251b4f576 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:04.593436 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a066066f-7452-461f-a33d-b08251b4f576 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:04.594286 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a066066f-7452-461f-a33d-b08251b4f576 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:04.594764 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a066066f-7452-461f-a33d-b08251b4f576 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:04.765341 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a066066f-7452-461f-a33d-b08251b4f576 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:04.780521 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a066066f-7452-461f-a33d-b08251b4f576 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.198968 Nov 24 16:06:04.781821 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 74/140] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:04 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:05.297523 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0f751331-41ba-4316-b4f3-51760c96489a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:05.298555 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0f751331-41ba-4316-b4f3-51760c96489a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:05.313214 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0f751331-41ba-4316-b4f3-51760c96489a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:05.314260 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0f751331-41ba-4316-b4f3-51760c96489a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:05.315384 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9ba6d27b-7e6a-44a0-815d-2157d7d713bb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:05.316101 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9ba6d27b-7e6a-44a0-815d-2157d7d713bb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:05.318269 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0f751331-41ba-4316-b4f3-51760c96489a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:05.319163 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0f751331-41ba-4316-b4f3-51760c96489a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:05.323355 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9ba6d27b-7e6a-44a0-815d-2157d7d713bb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:05.323944 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9ba6d27b-7e6a-44a0-815d-2157d7d713bb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:05.327466 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9ba6d27b-7e6a-44a0-815d-2157d7d713bb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:05.328084 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9ba6d27b-7e6a-44a0-815d-2157d7d713bb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:05.507131 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9ba6d27b-7e6a-44a0-815d-2157d7d713bb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:05.511548 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0f751331-41ba-4316-b4f3-51760c96489a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:05.519663 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0f751331-41ba-4316-b4f3-51760c96489a tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.228594 Nov 24 16:06:05.520833 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 67/141] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:05 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:05.524885 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3f97537e-4dcf-47b6-93a2-dce4c14cf0f2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:05.525343 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9ba6d27b-7e6a-44a0-815d-2157d7d713bb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.213872 Nov 24 16:06:05.525758 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3f97537e-4dcf-47b6-93a2-dce4c14cf0f2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:05.532834 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 75/142] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:05 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:05.537847 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3f97537e-4dcf-47b6-93a2-dce4c14cf0f2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:05.538488 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3f97537e-4dcf-47b6-93a2-dce4c14cf0f2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:05.539408 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3f97537e-4dcf-47b6-93a2-dce4c14cf0f2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:05.540038 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3f97537e-4dcf-47b6-93a2-dce4c14cf0f2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:05.618847 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e32467ff-62ad-41a1-80c4-07d27abe3eb4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:05.619474 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e32467ff-62ad-41a1-80c4-07d27abe3eb4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:05.626431 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e32467ff-62ad-41a1-80c4-07d27abe3eb4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:05.626877 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e32467ff-62ad-41a1-80c4-07d27abe3eb4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:05.627943 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e32467ff-62ad-41a1-80c4-07d27abe3eb4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:05.628400 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e32467ff-62ad-41a1-80c4-07d27abe3eb4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:05.728617 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3f97537e-4dcf-47b6-93a2-dce4c14cf0f2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:05.736404 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3f97537e-4dcf-47b6-93a2-dce4c14cf0f2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.214953 Nov 24 16:06:05.737010 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 68/143] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:05 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:05.797438 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e32467ff-62ad-41a1-80c4-07d27abe3eb4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:05.798062 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8ba4f254-c1e3-43d8-b6dd-fb50b767d1e3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:05.798675 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8ba4f254-c1e3-43d8-b6dd-fb50b767d1e3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:05.804897 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ba4f254-c1e3-43d8-b6dd-fb50b767d1e3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:05.805398 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ba4f254-c1e3-43d8-b6dd-fb50b767d1e3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:05.805997 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e32467ff-62ad-41a1-80c4-07d27abe3eb4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:05.806260 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ba4f254-c1e3-43d8-b6dd-fb50b767d1e3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:05.806614 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ba4f254-c1e3-43d8-b6dd-fb50b767d1e3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:05.808351 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e32467ff-62ad-41a1-80c4-07d27abe3eb4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:05.809755 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e32467ff-62ad-41a1-80c4-07d27abe3eb4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.194757 Nov 24 16:06:05.810602 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 76/144] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:06:05 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:06:05.944132 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8ba4f254-c1e3-43d8-b6dd-fb50b767d1e3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:05.953295 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8ba4f254-c1e3-43d8-b6dd-fb50b767d1e3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.158911 Nov 24 16:06:05.954017 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 69/145] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:05 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:06.539820 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0e504443-ce31-4b1c-a713-bbd9e050ee55 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:06.540616 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0e504443-ce31-4b1c-a713-bbd9e050ee55 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:06.545480 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8312d10a-dd11-456e-93b0-40a704594018 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:06.546766 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8312d10a-dd11-456e-93b0-40a704594018 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:06.547418 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0e504443-ce31-4b1c-a713-bbd9e050ee55 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:06.547886 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0e504443-ce31-4b1c-a713-bbd9e050ee55 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:06.548947 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0e504443-ce31-4b1c-a713-bbd9e050ee55 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:06.549440 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0e504443-ce31-4b1c-a713-bbd9e050ee55 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:06.554198 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8312d10a-dd11-456e-93b0-40a704594018 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:06.554625 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8312d10a-dd11-456e-93b0-40a704594018 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:06.555450 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8312d10a-dd11-456e-93b0-40a704594018 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:06.556068 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8312d10a-dd11-456e-93b0-40a704594018 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:06.725406 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8312d10a-dd11-456e-93b0-40a704594018 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:06.725658 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-0e504443-ce31-4b1c-a713-bbd9e050ee55 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:06.733714 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8312d10a-dd11-456e-93b0-40a704594018 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.193512 Nov 24 16:06:06.734299 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 70/146] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:06 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:06.741967 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0e504443-ce31-4b1c-a713-bbd9e050ee55 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.205194 Nov 24 16:06:06.743057 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 77/147] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:06 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:06.758489 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9632c541-c197-428e-80ae-d18267a93f53 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:06.759734 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9632c541-c197-428e-80ae-d18267a93f53 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:06.770315 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9632c541-c197-428e-80ae-d18267a93f53 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:06.771031 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9632c541-c197-428e-80ae-d18267a93f53 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:06.772679 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9632c541-c197-428e-80ae-d18267a93f53 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:06.773514 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9632c541-c197-428e-80ae-d18267a93f53 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:06.829724 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d8916fa3-ac63-41de-9e00-92f439a66b5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:06.830343 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d8916fa3-ac63-41de-9e00-92f439a66b5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:06.839407 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d8916fa3-ac63-41de-9e00-92f439a66b5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:06.839855 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d8916fa3-ac63-41de-9e00-92f439a66b5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:06.841195 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d8916fa3-ac63-41de-9e00-92f439a66b5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:06.841637 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d8916fa3-ac63-41de-9e00-92f439a66b5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:06.929917 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9632c541-c197-428e-80ae-d18267a93f53 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:06.948815 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9632c541-c197-428e-80ae-d18267a93f53 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.193042 Nov 24 16:06:06.949456 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 71/148] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:06 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:06.970707 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5653a7ff-c2b2-425b-b667-7a228b369dcd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:06.971378 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5653a7ff-c2b2-425b-b667-7a228b369dcd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:06.981666 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5653a7ff-c2b2-425b-b667-7a228b369dcd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:06.982876 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5653a7ff-c2b2-425b-b667-7a228b369dcd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:06.984660 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5653a7ff-c2b2-425b-b667-7a228b369dcd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:06.985724 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5653a7ff-c2b2-425b-b667-7a228b369dcd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:07.033198 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d8916fa3-ac63-41de-9e00-92f439a66b5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:07.048825 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d8916fa3-ac63-41de-9e00-92f439a66b5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:07.051499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d8916fa3-ac63-41de-9e00-92f439a66b5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:07.053185 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d8916fa3-ac63-41de-9e00-92f439a66b5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.229017 Nov 24 16:06:07.053946 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 78/149] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:06:06 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:06:07.144349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5653a7ff-c2b2-425b-b667-7a228b369dcd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:07.155253 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5653a7ff-c2b2-425b-b667-7a228b369dcd tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.188111 Nov 24 16:06:07.158784 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 72/150] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:06 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:07.753165 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-485b76e9-7efa-4c72-ac00-a0e590d8d1da tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:07.754106 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-485b76e9-7efa-4c72-ac00-a0e590d8d1da tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:07.762109 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-485b76e9-7efa-4c72-ac00-a0e590d8d1da tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:07.763067 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-485b76e9-7efa-4c72-ac00-a0e590d8d1da tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:07.764170 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-485b76e9-7efa-4c72-ac00-a0e590d8d1da tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:07.764448 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c33835d5-dbf5-4bd7-b88d-d2aa28608ae6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:07.765298 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-485b76e9-7efa-4c72-ac00-a0e590d8d1da tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:07.766226 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c33835d5-dbf5-4bd7-b88d-d2aa28608ae6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:07.776525 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c33835d5-dbf5-4bd7-b88d-d2aa28608ae6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:07.777275 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c33835d5-dbf5-4bd7-b88d-d2aa28608ae6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:07.779187 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c33835d5-dbf5-4bd7-b88d-d2aa28608ae6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:07.779966 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c33835d5-dbf5-4bd7-b88d-d2aa28608ae6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:07.998187 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c33835d5-dbf5-4bd7-b88d-d2aa28608ae6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:08.016417 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c33835d5-dbf5-4bd7-b88d-d2aa28608ae6 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1313 microversion: 2.1 time: 0.258032 Nov 24 16:06:08.018132 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 73/151] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:07 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:08.027859 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-485b76e9-7efa-4c72-ac00-a0e590d8d1da tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:08.037328 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e10d3dd2-502a-4146-a642-336a91eda516 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:08.038112 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e10d3dd2-502a-4146-a642-336a91eda516 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:08.041575 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-485b76e9-7efa-4c72-ac00-a0e590d8d1da tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.294189 Nov 24 16:06:08.042540 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 79/152] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:07 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:08.052045 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e10d3dd2-502a-4146-a642-336a91eda516 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:08.052685 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e10d3dd2-502a-4146-a642-336a91eda516 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:08.053775 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e10d3dd2-502a-4146-a642-336a91eda516 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:08.054356 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e10d3dd2-502a-4146-a642-336a91eda516 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:08.077252 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-86afff0b-4357-4cd7-859f-5c33ae945fa1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:08.078116 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-86afff0b-4357-4cd7-859f-5c33ae945fa1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:08.087636 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-86afff0b-4357-4cd7-859f-5c33ae945fa1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:08.088630 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-86afff0b-4357-4cd7-859f-5c33ae945fa1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:08.090221 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-86afff0b-4357-4cd7-859f-5c33ae945fa1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:08.091800 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-86afff0b-4357-4cd7-859f-5c33ae945fa1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:08.327054 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e10d3dd2-502a-4146-a642-336a91eda516 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:08.348479 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e10d3dd2-502a-4146-a642-336a91eda516 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.327997 Nov 24 16:06:08.349606 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 74/153] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:08 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:08.367905 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c86290b0-69e3-44c4-b992-77b15955a3f1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:08.369588 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c86290b0-69e3-44c4-b992-77b15955a3f1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:08.381076 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c86290b0-69e3-44c4-b992-77b15955a3f1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:08.381509 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c86290b0-69e3-44c4-b992-77b15955a3f1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:08.383726 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c86290b0-69e3-44c4-b992-77b15955a3f1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:08.384159 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c86290b0-69e3-44c4-b992-77b15955a3f1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:08.386469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-86afff0b-4357-4cd7-859f-5c33ae945fa1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:08.403800 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-86afff0b-4357-4cd7-859f-5c33ae945fa1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:08.406851 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-86afff0b-4357-4cd7-859f-5c33ae945fa1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:08.408528 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-86afff0b-4357-4cd7-859f-5c33ae945fa1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1407 microversion: 2.20 time: 0.338534 Nov 24 16:06:08.426353 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 80/154] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:06:08 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:06:08.656988 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c86290b0-69e3-44c4-b992-77b15955a3f1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:08.683162 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c86290b0-69e3-44c4-b992-77b15955a3f1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1318 microversion: 2.1 time: 0.331270 Nov 24 16:06:08.684564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 75/155] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:08 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:09.005708 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-68e6414d-00b5-4cb0-b98f-1955a4befb3d req-bb19e547-7323-424b-8ab0-fbb80901506e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a9b563-1f54-4c61-923f-9b557a3c307b", "name": "network-vif-plugged", "status": "completed", "tag": "533d257a-8aad-4722-8f01-84015f80cdd5"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:09.008754 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:06:09.008754 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:06:09.024494 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-68e6414d-00b5-4cb0-b98f-1955a4befb3d req-bb19e547-7323-424b-8ab0-fbb80901506e service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:09.025205 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-68e6414d-00b5-4cb0-b98f-1955a4befb3d req-bb19e547-7323-424b-8ab0-fbb80901506e service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:09.043811 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ff9c6db3-4318-4433-b953-d5b7e941b681 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:09.045199 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ff9c6db3-4318-4433-b953-d5b7e941b681 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:09.053741 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-68e6414d-00b5-4cb0-b98f-1955a4befb3d req-bb19e547-7323-424b-8ab0-fbb80901506e service nova] Creating event network-vif-plugged:533d257a-8aad-4722-8f01-84015f80cdd5 for instance a3a9b563-1f54-4c61-923f-9b557a3c307b on hv-cinder-81899 Nov 24 16:06:09.054015 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ff9c6db3-4318-4433-b953-d5b7e941b681 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:09.054767 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ff9c6db3-4318-4433-b953-d5b7e941b681 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:09.055768 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ff9c6db3-4318-4433-b953-d5b7e941b681 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:09.056350 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ff9c6db3-4318-4433-b953-d5b7e941b681 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:09.063850 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-68e6414d-00b5-4cb0-b98f-1955a4befb3d req-bb19e547-7323-424b-8ab0-fbb80901506e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064783 Nov 24 16:06:09.065347 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 81/156] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:06:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:06:09.075584 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fd9a02cf-fe69-4879-ba7e-b8960fb1484b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:09.076908 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fd9a02cf-fe69-4879-ba7e-b8960fb1484b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:09.088804 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fd9a02cf-fe69-4879-ba7e-b8960fb1484b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:09.089627 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fd9a02cf-fe69-4879-ba7e-b8960fb1484b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:09.091293 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fd9a02cf-fe69-4879-ba7e-b8960fb1484b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:09.092512 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fd9a02cf-fe69-4879-ba7e-b8960fb1484b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:09.277189 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ff9c6db3-4318-4433-b953-d5b7e941b681 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:09.288751 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ff9c6db3-4318-4433-b953-d5b7e941b681 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1500 microversion: 2.1 time: 0.250376 Nov 24 16:06:09.290934 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 76/157] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:09 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1500 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:09.367894 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-37338b7d-7987-4ef0-853b-2cbae1076c3b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:09.368790 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-37338b7d-7987-4ef0-853b-2cbae1076c3b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:09.383075 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-37338b7d-7987-4ef0-853b-2cbae1076c3b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:09.384849 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-37338b7d-7987-4ef0-853b-2cbae1076c3b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:09.385982 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-37338b7d-7987-4ef0-853b-2cbae1076c3b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:09.389617 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-37338b7d-7987-4ef0-853b-2cbae1076c3b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:09.748275 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-fd9a02cf-fe69-4879-ba7e-b8960fb1484b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:09.766033 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fd9a02cf-fe69-4879-ba7e-b8960fb1484b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.698434 Nov 24 16:06:09.767512 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 82/158] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:09 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:09.778282 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-968df880-fb7a-46da-b20b-319e4b52a299 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:09.780065 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-968df880-fb7a-46da-b20b-319e4b52a299 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:09.792571 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-968df880-fb7a-46da-b20b-319e4b52a299 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:09.794968 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-968df880-fb7a-46da-b20b-319e4b52a299 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:09.796845 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-968df880-fb7a-46da-b20b-319e4b52a299 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:09.798384 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-968df880-fb7a-46da-b20b-319e4b52a299 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:10.249631 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-37338b7d-7987-4ef0-853b-2cbae1076c3b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:10.291351 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-37338b7d-7987-4ef0-853b-2cbae1076c3b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.922153 Nov 24 16:06:10.309815 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 77/159] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:09 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:10.334416 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-26adb6aa-ba8e-4832-9151-c9b2cfba93b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:10.335248 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-26adb6aa-ba8e-4832-9151-c9b2cfba93b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:10.369833 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26adb6aa-ba8e-4832-9151-c9b2cfba93b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:10.371472 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26adb6aa-ba8e-4832-9151-c9b2cfba93b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:10.380443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26adb6aa-ba8e-4832-9151-c9b2cfba93b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:10.381441 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26adb6aa-ba8e-4832-9151-c9b2cfba93b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:10.404762 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-968df880-fb7a-46da-b20b-319e4b52a299 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:10.419991 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-968df880-fb7a-46da-b20b-319e4b52a299 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:10.438724 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-968df880-fb7a-46da-b20b-319e4b52a299 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:10.454347 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-968df880-fb7a-46da-b20b-319e4b52a299 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1598 microversion: 2.20 time: 0.684369 Nov 24 16:06:10.459958 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 83/160] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:06:09 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1598 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:06:10.499738 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9f245f21-c00f-4517-9eb5-b500c0ed1e6d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:10.500255 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9f245f21-c00f-4517-9eb5-b500c0ed1e6d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:10.517951 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9f245f21-c00f-4517-9eb5-b500c0ed1e6d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:10.518396 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9f245f21-c00f-4517-9eb5-b500c0ed1e6d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:10.519722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9f245f21-c00f-4517-9eb5-b500c0ed1e6d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:10.520430 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9f245f21-c00f-4517-9eb5-b500c0ed1e6d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:10.766554 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9f245f21-c00f-4517-9eb5-b500c0ed1e6d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.271380 Nov 24 16:06:10.767576 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 84/161] 10.222.0.72 () {60 vars in 1315 bytes} [Wed Nov 24 16:06:10 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/os-interface => generated 284 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:10.782553 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-26adb6aa-ba8e-4832-9151-c9b2cfba93b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:10.801465 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-26adb6aa-ba8e-4832-9151-c9b2cfba93b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1508 microversion: 2.1 time: 0.489965 Nov 24 16:06:10.803191 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 78/162] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:10 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1508 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:10.807154 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a1d6b55c-f6e7-4177-a3ce-a1648e7c8db3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:10.808428 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a1d6b55c-f6e7-4177-a3ce-a1648e7c8db3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:10.858246 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a1d6b55c-f6e7-4177-a3ce-a1648e7c8db3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:10.861622 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a1d6b55c-f6e7-4177-a3ce-a1648e7c8db3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:10.864500 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a1d6b55c-f6e7-4177-a3ce-a1648e7c8db3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:10.871759 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a1d6b55c-f6e7-4177-a3ce-a1648e7c8db3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:11.174961 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-9ea70c94-8fd9-4dd5-96b7-da37005b4fb9 req-25d8186d-7dc0-4421-ac8b-6e702875115d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f50ef3-7864-4548-8230-12ddb5ef83a0", "name": "network-vif-plugged", "status": "completed", "tag": "a424f220-1812-4f50-ab01-68a1923ec96d"}, {"server_uuid": "80f67d55-afc9-4ce8-a9c5-8256298c4b7e", "name": "network-vif-plugged", "status": "completed", "tag": "1c836e44-a6b1-400d-a64b-3d1e5a65fd29"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:11.197645 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:06:11.197645 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:06:11.255813 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-9ea70c94-8fd9-4dd5-96b7-da37005b4fb9 req-25d8186d-7dc0-4421-ac8b-6e702875115d service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:11.256900 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-9ea70c94-8fd9-4dd5-96b7-da37005b4fb9 req-25d8186d-7dc0-4421-ac8b-6e702875115d service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:11.321085 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-9ea70c94-8fd9-4dd5-96b7-da37005b4fb9 req-25d8186d-7dc0-4421-ac8b-6e702875115d service nova] Creating event network-vif-plugged:a424f220-1812-4f50-ab01-68a1923ec96d for instance 32f50ef3-7864-4548-8230-12ddb5ef83a0 on hv-cinder-81899 Nov 24 16:06:11.321922 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-9ea70c94-8fd9-4dd5-96b7-da37005b4fb9 req-25d8186d-7dc0-4421-ac8b-6e702875115d service nova] Creating event network-vif-plugged:1c836e44-a6b1-400d-a64b-3d1e5a65fd29 for instance 80f67d55-afc9-4ce8-a9c5-8256298c4b7e on hv-cinder-81899 Nov 24 16:06:11.322928 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-9ea70c94-8fd9-4dd5-96b7-da37005b4fb9 req-25d8186d-7dc0-4421-ac8b-6e702875115d service nova] Acquired lock "compute-rpcapi-router" {{(pid=116304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 24 16:06:11.324509 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-490be156-cd83-4c1d-ba2e-f078153f7a0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:11.326472 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-490be156-cd83-4c1d-ba2e-f078153f7a0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:11.336339 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-490be156-cd83-4c1d-ba2e-f078153f7a0e None None] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:11.337253 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-490be156-cd83-4c1d-ba2e-f078153f7a0e None None] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:11.364369 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.compute.rpcapi [None req-490be156-cd83-4c1d-ba2e-f078153f7a0e None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 24 16:06:11.365676 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-490be156-cd83-4c1d-ba2e-f078153f7a0e None None] Releasing lock "compute-rpcapi-router" {{(pid=116304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 24 16:06:11.438246 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-490be156-cd83-4c1d-ba2e-f078153f7a0e None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.285152 Nov 24 16:06:11.439607 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 79/163] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:06:11 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:06:11.445388 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c3449c38-00ea-4d58-9ec6-af5a8d1ffb06 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:11.446124 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c3449c38-00ea-4d58-9ec6-af5a8d1ffb06 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:11.463923 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c3449c38-00ea-4d58-9ec6-af5a8d1ffb06 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:11.464679 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c3449c38-00ea-4d58-9ec6-af5a8d1ffb06 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:11.466498 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c3449c38-00ea-4d58-9ec6-af5a8d1ffb06 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:11.475261 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c3449c38-00ea-4d58-9ec6-af5a8d1ffb06 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:11.595548 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a1d6b55c-f6e7-4177-a3ce-a1648e7c8db3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:11.612461 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a1d6b55c-f6e7-4177-a3ce-a1648e7c8db3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.817553 Nov 24 16:06:11.628970 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 85/164] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:10 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:11.656791 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-db2cbb8a-f75c-402a-bf0b-f02d2c059bd3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74a65f6f-3730-4ff7-8bf1-c466036e40b7"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:11.666354 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-db2cbb8a-f75c-402a-bf0b-f02d2c059bd3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:11.703316 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-db2cbb8a-f75c-402a-bf0b-f02d2c059bd3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:11.706338 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-db2cbb8a-f75c-402a-bf0b-f02d2c059bd3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:11.711392 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-db2cbb8a-f75c-402a-bf0b-f02d2c059bd3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:11.714599 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-db2cbb8a-f75c-402a-bf0b-f02d2c059bd3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:12.428885 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c3449c38-00ea-4d58-9ec6-af5a8d1ffb06 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:12.454577 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c3449c38-00ea-4d58-9ec6-af5a8d1ffb06 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 1.013221 Nov 24 16:06:12.459319 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 80/165] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:11 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:12.635230 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2d87cea8-58c7-41ba-b9b2-42ef4e4e85c0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:12.635422 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2d87cea8-58c7-41ba-b9b2-42ef4e4e85c0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:12.649432 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2d87cea8-58c7-41ba-b9b2-42ef4e4e85c0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:12.650997 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2d87cea8-58c7-41ba-b9b2-42ef4e4e85c0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:12.653445 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2d87cea8-58c7-41ba-b9b2-42ef4e4e85c0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:12.654401 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2d87cea8-58c7-41ba-b9b2-42ef4e4e85c0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:12.915618 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2d87cea8-58c7-41ba-b9b2-42ef4e4e85c0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:12.926026 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2d87cea8-58c7-41ba-b9b2-42ef4e4e85c0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.297809 Nov 24 16:06:12.927162 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 81/166] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:12 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:12.934617 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ec77c1a0-fff1-4e32-8fdd-9faec0a6d6b1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4852b165-a78a-4442-8767-dff090e94f94"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:12.935942 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ec77c1a0-fff1-4e32-8fdd-9faec0a6d6b1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:12.945940 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ec77c1a0-fff1-4e32-8fdd-9faec0a6d6b1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:12.946849 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ec77c1a0-fff1-4e32-8fdd-9faec0a6d6b1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:12.948935 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ec77c1a0-fff1-4e32-8fdd-9faec0a6d6b1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:12.950699 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ec77c1a0-fff1-4e32-8fdd-9faec0a6d6b1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:13.421728 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-db2cbb8a-f75c-402a-bf0b-f02d2c059bd3 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "POST /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.790731 Nov 24 16:06:13.426768 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 86/167] 10.222.0.72 () {60 vars in 1322 bytes} [Wed Nov 24 16:06:11 2021] POST /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c/os-volume_attachments => generated 194 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:06:13.482386 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-708aef1f-a47e-40b7-95b2-be55cd29a0e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:13.486775 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-708aef1f-a47e-40b7-95b2-be55cd29a0e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:13.521799 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-708aef1f-a47e-40b7-95b2-be55cd29a0e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:13.524067 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-708aef1f-a47e-40b7-95b2-be55cd29a0e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:13.527182 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-708aef1f-a47e-40b7-95b2-be55cd29a0e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:13.529601 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-708aef1f-a47e-40b7-95b2-be55cd29a0e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:13.785767 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ec77c1a0-fff1-4e32-8fdd-9faec0a6d6b1 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "POST /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.853961 Nov 24 16:06:13.786904 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 82/168] 10.222.0.72 () {60 vars in 1322 bytes} [Wed Nov 24 16:06:12 2021] POST /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments => generated 194 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:06:13.951728 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-75cbab8a-83a7-4e41-9b65-3db83ff6a936 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:13.954453 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-75cbab8a-83a7-4e41-9b65-3db83ff6a936 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:13.985929 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-75cbab8a-83a7-4e41-9b65-3db83ff6a936 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:13.987348 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-75cbab8a-83a7-4e41-9b65-3db83ff6a936 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:13.991893 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-75cbab8a-83a7-4e41-9b65-3db83ff6a936 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:13.993144 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-75cbab8a-83a7-4e41-9b65-3db83ff6a936 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:14.030871 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-708aef1f-a47e-40b7-95b2-be55cd29a0e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:14.043129 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-708aef1f-a47e-40b7-95b2-be55cd29a0e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1361 microversion: 2.1 time: 0.569311 Nov 24 16:06:14.044930 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 87/169] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:13 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1361 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:14.381886 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-75cbab8a-83a7-4e41-9b65-3db83ff6a936 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:14.406662 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-75cbab8a-83a7-4e41-9b65-3db83ff6a936 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1322 microversion: 2.1 time: 0.461629 Nov 24 16:06:14.426305 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 83/170] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:13 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:14.466152 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3bdbcb63-c28e-4c0c-b9c9-c5dab21b6048 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:14.468295 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3bdbcb63-c28e-4c0c-b9c9-c5dab21b6048 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:14.470885 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-f2025b08-7828-4780-8518-4c6fae9ada68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:14.475639 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:06:14.475639 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:06:14.490967 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-f2025b08-7828-4780-8518-4c6fae9ada68 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:14.494102 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3bdbcb63-c28e-4c0c-b9c9-c5dab21b6048 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:14.495876 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3bdbcb63-c28e-4c0c-b9c9-c5dab21b6048 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:14.496047 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-f2025b08-7828-4780-8518-4c6fae9ada68 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:14.499555 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3bdbcb63-c28e-4c0c-b9c9-c5dab21b6048 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:14.501653 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3bdbcb63-c28e-4c0c-b9c9-c5dab21b6048 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:14.552167 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-f2025b08-7828-4780-8518-4c6fae9ada68 service nova] Creating event network-changed:0cc6f513-6305-463b-bb1d-17ec8928f67c for instance 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 on hv-cinder-81899 Nov 24 16:06:14.572248 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-5c24697e-09fc-4dfb-b346-0cdc8f5f0e72 req-f2025b08-7828-4780-8518-4c6fae9ada68 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111468 Nov 24 16:06:14.577588 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 84/171] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:06:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:06:14.628496 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3bdbcb63-c28e-4c0c-b9c9-c5dab21b6048 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 14 microversion: 2.20 time: 0.178041 Nov 24 16:06:14.629611 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 88/172] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:14 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:15.078592 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-20dc412c-791d-458f-a0e6-196a24f5d788 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:15.079903 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-20dc412c-791d-458f-a0e6-196a24f5d788 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:15.088889 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-20dc412c-791d-458f-a0e6-196a24f5d788 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:15.089361 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-20dc412c-791d-458f-a0e6-196a24f5d788 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:15.090915 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-20dc412c-791d-458f-a0e6-196a24f5d788 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:15.091363 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-20dc412c-791d-458f-a0e6-196a24f5d788 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:15.309977 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-20dc412c-791d-458f-a0e6-196a24f5d788 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:15.324345 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-20dc412c-791d-458f-a0e6-196a24f5d788 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1547 microversion: 2.1 time: 0.253074 Nov 24 16:06:15.326832 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 85/173] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:15 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1547 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:15.370094 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b562a56d-be35-4862-b98b-217eca58222c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:15.373421 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b562a56d-be35-4862-b98b-217eca58222c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:15.389843 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b562a56d-be35-4862-b98b-217eca58222c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:15.391045 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b562a56d-be35-4862-b98b-217eca58222c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:15.393341 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b562a56d-be35-4862-b98b-217eca58222c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:15.395779 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b562a56d-be35-4862-b98b-217eca58222c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:15.439431 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-30450ae6-7705-4514-b6f5-979f4c3758db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:15.442338 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-30450ae6-7705-4514-b6f5-979f4c3758db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:15.477759 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-30450ae6-7705-4514-b6f5-979f4c3758db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:15.479188 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-30450ae6-7705-4514-b6f5-979f4c3758db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:15.481665 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-30450ae6-7705-4514-b6f5-979f4c3758db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:15.482471 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-30450ae6-7705-4514-b6f5-979f4c3758db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:15.588026 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b562a56d-be35-4862-b98b-217eca58222c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.230049 Nov 24 16:06:15.590174 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 89/174] 10.222.0.72 () {58 vars in 1274 bytes} [Wed Nov 24 16:06:15 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:06:15.644743 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-53586543-0ae4-4164-8d8d-6ef477ccdc0c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:15.650691 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-53586543-0ae4-4164-8d8d-6ef477ccdc0c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:15.676056 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-53586543-0ae4-4164-8d8d-6ef477ccdc0c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:15.679926 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-53586543-0ae4-4164-8d8d-6ef477ccdc0c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:15.684590 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-53586543-0ae4-4164-8d8d-6ef477ccdc0c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:15.685983 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-53586543-0ae4-4164-8d8d-6ef477ccdc0c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:15.796995 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-30450ae6-7705-4514-b6f5-979f4c3758db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:15.819315 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-30450ae6-7705-4514-b6f5-979f4c3758db tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1516 microversion: 2.1 time: 0.388047 Nov 24 16:06:15.820729 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 86/175] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:15 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1516 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:15.855268 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b94f4585-b8a2-48ea-a655-6e7a549d167c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:15.857913 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b94f4585-b8a2-48ea-a655-6e7a549d167c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:15.869870 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b94f4585-b8a2-48ea-a655-6e7a549d167c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:15.870924 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b94f4585-b8a2-48ea-a655-6e7a549d167c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:15.873551 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b94f4585-b8a2-48ea-a655-6e7a549d167c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:15.874388 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b94f4585-b8a2-48ea-a655-6e7a549d167c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:15.924740 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-b94f4585-b8a2-48ea-a655-6e7a549d167c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lazy-loading 'flavor' on Instance uuid 32f50ef3-7864-4548-8230-12ddb5ef83a0 {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:06:16.143275 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b94f4585-b8a2-48ea-a655-6e7a549d167c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "POST /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0/action" status: 200 len: 32 microversion: 2.1 time: 0.296682 Nov 24 16:06:16.146014 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 87/176] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:15 2021] POST /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0/action => generated 32 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:06:16.161220 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d4678d95-dcb3-4b29-a8a6-ee81cae49a74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:16.163040 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d4678d95-dcb3-4b29-a8a6-ee81cae49a74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:16.184985 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d4678d95-dcb3-4b29-a8a6-ee81cae49a74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:16.185627 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d4678d95-dcb3-4b29-a8a6-ee81cae49a74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:16.186558 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d4678d95-dcb3-4b29-a8a6-ee81cae49a74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:16.187259 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d4678d95-dcb3-4b29-a8a6-ee81cae49a74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:16.421099 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d4678d95-dcb3-4b29-a8a6-ee81cae49a74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:16.432544 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d4678d95-dcb3-4b29-a8a6-ee81cae49a74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.279996 Nov 24 16:06:16.433547 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 88/177] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:16 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:17.221218 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ea171ec2-073a-4968-b01f-593d7250e4c2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:17.226710 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ea171ec2-073a-4968-b01f-593d7250e4c2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:17.242539 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea171ec2-073a-4968-b01f-593d7250e4c2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:17.244369 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea171ec2-073a-4968-b01f-593d7250e4c2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:17.246117 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea171ec2-073a-4968-b01f-593d7250e4c2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:17.247895 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea171ec2-073a-4968-b01f-593d7250e4c2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:19.020039 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-53586543-0ae4-4164-8d8d-6ef477ccdc0c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 14 microversion: 2.20 time: 3.382684 Nov 24 16:06:19.020963 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ea171ec2-073a-4968-b01f-593d7250e4c2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 14 microversion: 2.1 time: 1.806114 Nov 24 16:06:19.025865 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 90/178] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:15 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 14 bytes in 3390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:19.028945 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 89/179] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:17 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 14 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 16:06:19.042307 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-db1344f0-3306-44a3-b2c5-c5db4ba71b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f67d55-afc9-4ce8-a9c5-8256298c4b7e", "tag": "1c836e44-a6b1-400d-a64b-3d1e5a65fd29"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:19.048015 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:06:19.048015 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:06:19.053145 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-25898f4d-fd98-4279-94af-87a7a9fd17f2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:19.070938 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-25898f4d-fd98-4279-94af-87a7a9fd17f2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:19.089950 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-db1344f0-3306-44a3-b2c5-c5db4ba71b58 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:19.091766 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-db1344f0-3306-44a3-b2c5-c5db4ba71b58 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:19.111700 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-25898f4d-fd98-4279-94af-87a7a9fd17f2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:19.114466 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-25898f4d-fd98-4279-94af-87a7a9fd17f2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:19.120783 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-25898f4d-fd98-4279-94af-87a7a9fd17f2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:19.123187 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-25898f4d-fd98-4279-94af-87a7a9fd17f2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:19.137492 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-db1344f0-3306-44a3-b2c5-c5db4ba71b58 service nova] Creating event network-changed:1c836e44-a6b1-400d-a64b-3d1e5a65fd29 for instance 80f67d55-afc9-4ce8-a9c5-8256298c4b7e on hv-cinder-81899 Nov 24 16:06:19.193337 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-d763ee2f-c50e-40fe-85c5-ab5154830d4c req-db1344f0-3306-44a3-b2c5-c5db4ba71b58 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149047 Nov 24 16:06:19.202962 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 91/180] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:06:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:06:20.023304 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-25898f4d-fd98-4279-94af-87a7a9fd17f2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:20.036465 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-05597a20-cf5d-4dc1-acaf-fdf2c9630e21 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:20.037601 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-05597a20-cf5d-4dc1-acaf-fdf2c9630e21 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:20.049070 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-05597a20-cf5d-4dc1-acaf-fdf2c9630e21 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:20.050605 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-05597a20-cf5d-4dc1-acaf-fdf2c9630e21 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:20.052708 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-05597a20-cf5d-4dc1-acaf-fdf2c9630e21 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:20.053730 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-05597a20-cf5d-4dc1-acaf-fdf2c9630e21 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:20.054277 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-25898f4d-fd98-4279-94af-87a7a9fd17f2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 1.022443 Nov 24 16:06:20.055321 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 90/181] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:19 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:20.070027 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-28d8f6c4-f826-448d-b581-8fe6b725fc28 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:20.071334 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-28d8f6c4-f826-448d-b581-8fe6b725fc28 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:20.094726 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-28d8f6c4-f826-448d-b581-8fe6b725fc28 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:20.095188 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-28d8f6c4-f826-448d-b581-8fe6b725fc28 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:20.096055 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-28d8f6c4-f826-448d-b581-8fe6b725fc28 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:20.096516 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-28d8f6c4-f826-448d-b581-8fe6b725fc28 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:20.217983 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-05597a20-cf5d-4dc1-acaf-fdf2c9630e21 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 14 microversion: 2.20 time: 0.186573 Nov 24 16:06:20.218725 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 92/182] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:20 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:20.225923 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-28d8f6c4-f826-448d-b581-8fe6b725fc28 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 14 microversion: 2.1 time: 0.158518 Nov 24 16:06:20.227296 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 91/183] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:20 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:06:21.078224 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4d77f949-f3be-4520-871e-2b4fab8bf27d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:21.080167 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4d77f949-f3be-4520-871e-2b4fab8bf27d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:21.090058 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4d77f949-f3be-4520-871e-2b4fab8bf27d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:21.090422 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4d77f949-f3be-4520-871e-2b4fab8bf27d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:21.091233 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4d77f949-f3be-4520-871e-2b4fab8bf27d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:21.091667 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4d77f949-f3be-4520-871e-2b4fab8bf27d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:21.255620 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a31f1166-2751-48d7-a089-e4dfcf8837af tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:21.270795 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a31f1166-2751-48d7-a089-e4dfcf8837af tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:21.296182 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a31f1166-2751-48d7-a089-e4dfcf8837af tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:21.296942 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a31f1166-2751-48d7-a089-e4dfcf8837af tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:21.298578 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a31f1166-2751-48d7-a089-e4dfcf8837af tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:21.299666 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a31f1166-2751-48d7-a089-e4dfcf8837af tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:21.384485 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4d77f949-f3be-4520-871e-2b4fab8bf27d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:21.396005 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4d77f949-f3be-4520-871e-2b4fab8bf27d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.326822 Nov 24 16:06:21.396605 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 93/184] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:21 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:21.401579 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e5635eef-a98c-4508-9620-bc218a33c4da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:21.403213 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e5635eef-a98c-4508-9620-bc218a33c4da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:21.410804 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e5635eef-a98c-4508-9620-bc218a33c4da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:21.411617 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e5635eef-a98c-4508-9620-bc218a33c4da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:21.412917 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e5635eef-a98c-4508-9620-bc218a33c4da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:21.413423 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e5635eef-a98c-4508-9620-bc218a33c4da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:21.420249 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a31f1166-2751-48d7-a089-e4dfcf8837af tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 14 microversion: 2.20 time: 0.191704 Nov 24 16:06:21.421248 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 92/185] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:21 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:21.502213 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e5635eef-a98c-4508-9620-bc218a33c4da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 14 microversion: 2.1 time: 0.103574 Nov 24 16:06:21.506393 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 94/186] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:21 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:06:22.426607 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-34c79567-f2d6-43d1-bed3-4e8a249b9b9b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:22.427766 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-34c79567-f2d6-43d1-bed3-4e8a249b9b9b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:22.435597 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3f5b8ae8-6623-460d-a844-7819339466b4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:22.436713 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3f5b8ae8-6623-460d-a844-7819339466b4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:22.440083 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-34c79567-f2d6-43d1-bed3-4e8a249b9b9b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:22.440797 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-34c79567-f2d6-43d1-bed3-4e8a249b9b9b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:22.445139 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-34c79567-f2d6-43d1-bed3-4e8a249b9b9b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:22.445946 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-34c79567-f2d6-43d1-bed3-4e8a249b9b9b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:22.446317 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f5b8ae8-6623-460d-a844-7819339466b4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:22.446857 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f5b8ae8-6623-460d-a844-7819339466b4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:22.448051 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f5b8ae8-6623-460d-a844-7819339466b4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:22.448547 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f5b8ae8-6623-460d-a844-7819339466b4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:22.560274 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3f5b8ae8-6623-460d-a844-7819339466b4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 14 microversion: 2.20 time: 0.129794 Nov 24 16:06:22.561489 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 95/187] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:22 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:22.571660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d2449c5e-dcbc-4952-a7dc-e7177ba60e65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:22.573355 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d2449c5e-dcbc-4952-a7dc-e7177ba60e65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:22.587122 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d2449c5e-dcbc-4952-a7dc-e7177ba60e65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:22.587932 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d2449c5e-dcbc-4952-a7dc-e7177ba60e65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:22.589381 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d2449c5e-dcbc-4952-a7dc-e7177ba60e65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:22.591665 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d2449c5e-dcbc-4952-a7dc-e7177ba60e65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:22.673153 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-34c79567-f2d6-43d1-bed3-4e8a249b9b9b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:22.682206 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-34c79567-f2d6-43d1-bed3-4e8a249b9b9b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.262534 Nov 24 16:06:22.682817 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 93/188] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:22 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:22.705978 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d2449c5e-dcbc-4952-a7dc-e7177ba60e65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 14 microversion: 2.1 time: 0.140842 Nov 24 16:06:22.706840 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 96/189] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:22 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:06:23.572424 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c8df87bc-0c0b-413a-81f8-e7f373f22d1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:23.574353 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c8df87bc-0c0b-413a-81f8-e7f373f22d1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:23.581568 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8df87bc-0c0b-413a-81f8-e7f373f22d1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:23.582015 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8df87bc-0c0b-413a-81f8-e7f373f22d1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:23.582909 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8df87bc-0c0b-413a-81f8-e7f373f22d1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:23.585172 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c8df87bc-0c0b-413a-81f8-e7f373f22d1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:23.679232 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c8df87bc-0c0b-413a-81f8-e7f373f22d1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 14 microversion: 2.20 time: 0.110430 Nov 24 16:06:23.681076 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 94/190] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:23 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:23.712436 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8047d50a-6031-47d9-be01-7bf2260f7b74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:23.715676 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8047d50a-6031-47d9-be01-7bf2260f7b74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:23.726306 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-600b1971-7a96-437c-aa33-4744ac28c8c3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:23.727875 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-600b1971-7a96-437c-aa33-4744ac28c8c3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:23.732308 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8047d50a-6031-47d9-be01-7bf2260f7b74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:23.733139 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8047d50a-6031-47d9-be01-7bf2260f7b74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:23.734294 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8047d50a-6031-47d9-be01-7bf2260f7b74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:23.734911 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8047d50a-6031-47d9-be01-7bf2260f7b74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:23.741861 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-600b1971-7a96-437c-aa33-4744ac28c8c3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:23.741861 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-600b1971-7a96-437c-aa33-4744ac28c8c3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:23.744093 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-600b1971-7a96-437c-aa33-4744ac28c8c3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:23.744812 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-600b1971-7a96-437c-aa33-4744ac28c8c3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:23.850897 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-600b1971-7a96-437c-aa33-4744ac28c8c3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 14 microversion: 2.1 time: 0.132792 Nov 24 16:06:23.851614 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 95/191] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:23 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:06:23.937977 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8047d50a-6031-47d9-be01-7bf2260f7b74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:23.953091 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8047d50a-6031-47d9-be01-7bf2260f7b74 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.255735 Nov 24 16:06:23.954250 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 97/192] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:23 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:24.691346 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-364ced35-516c-4f69-be72-d07b61eaafb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:24.692583 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-364ced35-516c-4f69-be72-d07b61eaafb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:24.700031 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-364ced35-516c-4f69-be72-d07b61eaafb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:24.700834 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-364ced35-516c-4f69-be72-d07b61eaafb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:24.701709 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-364ced35-516c-4f69-be72-d07b61eaafb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:24.702407 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-364ced35-516c-4f69-be72-d07b61eaafb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:24.793644 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-364ced35-516c-4f69-be72-d07b61eaafb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 14 microversion: 2.20 time: 0.105382 Nov 24 16:06:24.794388 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 96/193] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:24 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:24.872019 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ac14ba01-ed24-4025-8b74-c73ab07e3cdb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:24.875305 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ac14ba01-ed24-4025-8b74-c73ab07e3cdb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:24.885203 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ac14ba01-ed24-4025-8b74-c73ab07e3cdb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:24.885973 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ac14ba01-ed24-4025-8b74-c73ab07e3cdb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:24.887573 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ac14ba01-ed24-4025-8b74-c73ab07e3cdb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:24.888610 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ac14ba01-ed24-4025-8b74-c73ab07e3cdb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:24.970104 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ac14ba01-ed24-4025-8b74-c73ab07e3cdb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 14 microversion: 2.1 time: 0.104713 Nov 24 16:06:24.973357 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 98/194] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:24 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:06:24.976516 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8464cfc8-9972-4b96-b494-29d1d2ab5925 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:24.977239 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8464cfc8-9972-4b96-b494-29d1d2ab5925 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:24.985857 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8464cfc8-9972-4b96-b494-29d1d2ab5925 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:24.986306 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8464cfc8-9972-4b96-b494-29d1d2ab5925 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:24.987121 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8464cfc8-9972-4b96-b494-29d1d2ab5925 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:24.987542 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8464cfc8-9972-4b96-b494-29d1d2ab5925 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:25.141698 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8464cfc8-9972-4b96-b494-29d1d2ab5925 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:25.150529 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8464cfc8-9972-4b96-b494-29d1d2ab5925 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.178844 Nov 24 16:06:25.151268 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 97/195] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:24 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:25.805486 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5fd6a046-2bc5-4a43-9bd0-c83723ddb744 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:25.806530 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5fd6a046-2bc5-4a43-9bd0-c83723ddb744 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:25.814241 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5fd6a046-2bc5-4a43-9bd0-c83723ddb744 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:25.814884 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5fd6a046-2bc5-4a43-9bd0-c83723ddb744 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:25.816185 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5fd6a046-2bc5-4a43-9bd0-c83723ddb744 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:25.816612 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5fd6a046-2bc5-4a43-9bd0-c83723ddb744 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:25.950890 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5fd6a046-2bc5-4a43-9bd0-c83723ddb744 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 5014 microversion: 2.20 time: 0.149020 Nov 24 16:06:25.951859 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 99/196] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:25 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 5014 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:06:25.981530 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a3d5da6c-8f51-4b9b-91e8-ce3946d7124f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:25.983290 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a3d5da6c-8f51-4b9b-91e8-ce3946d7124f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:25.989929 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3d5da6c-8f51-4b9b-91e8-ce3946d7124f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:25.990567 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3d5da6c-8f51-4b9b-91e8-ce3946d7124f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:25.991413 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3d5da6c-8f51-4b9b-91e8-ce3946d7124f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:25.991882 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3d5da6c-8f51-4b9b-91e8-ce3946d7124f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:26.103879 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a3d5da6c-8f51-4b9b-91e8-ce3946d7124f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 14 microversion: 2.1 time: 0.126526 Nov 24 16:06:26.104495 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 98/197] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:25 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 16:06:26.175592 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-bb927bcd-dff8-488d-88d9-0bffaa02c392 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:26.176704 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-bb927bcd-dff8-488d-88d9-0bffaa02c392 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:26.184670 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bb927bcd-dff8-488d-88d9-0bffaa02c392 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:26.185640 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bb927bcd-dff8-488d-88d9-0bffaa02c392 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:26.186692 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bb927bcd-dff8-488d-88d9-0bffaa02c392 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:26.187356 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bb927bcd-dff8-488d-88d9-0bffaa02c392 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:26.381199 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-bb927bcd-dff8-488d-88d9-0bffaa02c392 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:26.395413 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-bb927bcd-dff8-488d-88d9-0bffaa02c392 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.223439 Nov 24 16:06:26.397105 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 100/198] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:26 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:26.963840 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f2aed725-8202-4df3-81e5-c473cbf174e1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:26.965811 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f2aed725-8202-4df3-81e5-c473cbf174e1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:26.984674 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f2aed725-8202-4df3-81e5-c473cbf174e1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:26.985386 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f2aed725-8202-4df3-81e5-c473cbf174e1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:26.986205 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f2aed725-8202-4df3-81e5-c473cbf174e1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:26.986679 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f2aed725-8202-4df3-81e5-c473cbf174e1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:27.115292 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c58baa47-c917-41bc-8ddf-ba8e11359e69 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:27.116196 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c58baa47-c917-41bc-8ddf-ba8e11359e69 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:27.128934 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c58baa47-c917-41bc-8ddf-ba8e11359e69 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:27.128934 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c58baa47-c917-41bc-8ddf-ba8e11359e69 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:27.128934 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c58baa47-c917-41bc-8ddf-ba8e11359e69 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:27.128934 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c58baa47-c917-41bc-8ddf-ba8e11359e69 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:27.133310 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f2aed725-8202-4df3-81e5-c473cbf174e1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 7937 microversion: 2.20 time: 0.174093 Nov 24 16:06:27.134248 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 99/199] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:26 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 7937 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:06:27.250874 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c58baa47-c917-41bc-8ddf-ba8e11359e69 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 14 microversion: 2.1 time: 0.137252 Nov 24 16:06:27.252604 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 101/200] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:27 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 16:06:27.416617 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cac1f7c5-dbd3-45eb-b4ef-df921a927110 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:27.417472 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cac1f7c5-dbd3-45eb-b4ef-df921a927110 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:27.425538 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cac1f7c5-dbd3-45eb-b4ef-df921a927110 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:27.426374 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cac1f7c5-dbd3-45eb-b4ef-df921a927110 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:27.427393 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cac1f7c5-dbd3-45eb-b4ef-df921a927110 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:27.428014 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cac1f7c5-dbd3-45eb-b4ef-df921a927110 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:27.578430 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cac1f7c5-dbd3-45eb-b4ef-df921a927110 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:27.592786 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cac1f7c5-dbd3-45eb-b4ef-df921a927110 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.180290 Nov 24 16:06:27.593429 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 100/201] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:27 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:28.148929 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8d21c4f5-c729-414a-8902-5ebf27bebb67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:28.150333 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8d21c4f5-c729-414a-8902-5ebf27bebb67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:28.162156 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8d21c4f5-c729-414a-8902-5ebf27bebb67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:28.162620 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8d21c4f5-c729-414a-8902-5ebf27bebb67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:28.163861 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8d21c4f5-c729-414a-8902-5ebf27bebb67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:28.164473 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8d21c4f5-c729-414a-8902-5ebf27bebb67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:28.275303 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-35bfa87c-b00f-42d0-baf5-b0f0a44d2eb2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:28.275303 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-35bfa87c-b00f-42d0-baf5-b0f0a44d2eb2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:28.286098 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8d21c4f5-c729-414a-8902-5ebf27bebb67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 11371 microversion: 2.20 time: 0.143057 Nov 24 16:06:28.286466 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-35bfa87c-b00f-42d0-baf5-b0f0a44d2eb2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:28.287360 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 102/202] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:28 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 11371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:06:28.287806 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-35bfa87c-b00f-42d0-baf5-b0f0a44d2eb2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:28.289331 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-35bfa87c-b00f-42d0-baf5-b0f0a44d2eb2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:28.290146 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-35bfa87c-b00f-42d0-baf5-b0f0a44d2eb2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:28.405676 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-35bfa87c-b00f-42d0-baf5-b0f0a44d2eb2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 14 microversion: 2.1 time: 0.145570 Nov 24 16:06:28.408884 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 101/203] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:28 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:06:28.529414 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:28.530249 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:28.537970 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:28.538683 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:28.539799 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:28.540245 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:28.583193 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Going to try to terminate instance {{(pid=116303) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:06:28.619284 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9402f01b-2f74-4fa3-b593-f010a7d3a409 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:28.620929 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9402f01b-2f74-4fa3-b593-f010a7d3a409 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:28.630889 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9402f01b-2f74-4fa3-b593-f010a7d3a409 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:28.631632 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9402f01b-2f74-4fa3-b593-f010a7d3a409 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:28.632773 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9402f01b-2f74-4fa3-b593-f010a7d3a409 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:28.633415 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9402f01b-2f74-4fa3-b593-f010a7d3a409 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:28.740463 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2838a000-7f21-4efb-87e1-b45a0cbc0a69 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 204 len: 0 microversion: 2.1 time: 0.218877 Nov 24 16:06:28.741945 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 103/204] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:06:28 2021] DELETE /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 16:06:28.752624 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-178af5c3-3ee3-4f86-a9d8-607cfbbd5d05 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:28.753720 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-178af5c3-3ee3-4f86-a9d8-607cfbbd5d05 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:28.761817 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-178af5c3-3ee3-4f86-a9d8-607cfbbd5d05 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:28.762746 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-178af5c3-3ee3-4f86-a9d8-607cfbbd5d05 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:28.763832 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-178af5c3-3ee3-4f86-a9d8-607cfbbd5d05 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:28.765114 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-178af5c3-3ee3-4f86-a9d8-607cfbbd5d05 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:28.848069 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9402f01b-2f74-4fa3-b593-f010a7d3a409 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:28.899068 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9402f01b-2f74-4fa3-b593-f010a7d3a409 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.285926 Nov 24 16:06:28.899707 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 102/205] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:28 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:29.034528 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-178af5c3-3ee3-4f86-a9d8-607cfbbd5d05 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:29.045243 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-178af5c3-3ee3-4f86-a9d8-607cfbbd5d05 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1552 microversion: 2.1 time: 0.297980 Nov 24 16:06:29.046066 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 104/206] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:28 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1552 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:29.299076 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-63f7b518-8cdb-4b4f-b5fc-d8f144b1b581 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:29.300273 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-63f7b518-8cdb-4b4f-b5fc-d8f144b1b581 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:29.307541 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63f7b518-8cdb-4b4f-b5fc-d8f144b1b581 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:29.307995 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63f7b518-8cdb-4b4f-b5fc-d8f144b1b581 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:29.309669 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63f7b518-8cdb-4b4f-b5fc-d8f144b1b581 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:29.310216 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63f7b518-8cdb-4b4f-b5fc-d8f144b1b581 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:29.411682 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-63f7b518-8cdb-4b4f-b5fc-d8f144b1b581 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 14402 microversion: 2.20 time: 0.115745 Nov 24 16:06:29.413603 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 103/207] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:29 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 14402 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:29.421637 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1e88acf7-85dd-487b-873a-572c045ba8e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:29.423367 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1e88acf7-85dd-487b-873a-572c045ba8e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:29.434311 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1e88acf7-85dd-487b-873a-572c045ba8e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:29.435791 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1e88acf7-85dd-487b-873a-572c045ba8e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:29.436830 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1e88acf7-85dd-487b-873a-572c045ba8e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:29.437572 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1e88acf7-85dd-487b-873a-572c045ba8e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:29.518332 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1e88acf7-85dd-487b-873a-572c045ba8e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 14 microversion: 2.1 time: 0.103288 Nov 24 16:06:29.522621 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 105/208] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:29 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:06:29.921004 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c6277210-b5db-448a-a0c6-5a5184ed2ebe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:29.922707 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c6277210-b5db-448a-a0c6-5a5184ed2ebe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:29.935448 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6277210-b5db-448a-a0c6-5a5184ed2ebe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:29.936225 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6277210-b5db-448a-a0c6-5a5184ed2ebe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:29.937599 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6277210-b5db-448a-a0c6-5a5184ed2ebe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:29.938330 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6277210-b5db-448a-a0c6-5a5184ed2ebe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:30.068184 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-699bc666-af23-44f4-a677-b56a7288fac4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:30.069289 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-699bc666-af23-44f4-a677-b56a7288fac4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:30.080668 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-699bc666-af23-44f4-a677-b56a7288fac4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:30.081320 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-699bc666-af23-44f4-a677-b56a7288fac4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:30.083123 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-699bc666-af23-44f4-a677-b56a7288fac4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:30.083946 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-699bc666-af23-44f4-a677-b56a7288fac4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:30.163253 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c6277210-b5db-448a-a0c6-5a5184ed2ebe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:30.175270 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c6277210-b5db-448a-a0c6-5a5184ed2ebe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.261316 Nov 24 16:06:30.175979 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 104/209] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:29 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:30.297895 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-699bc666-af23-44f4-a677-b56a7288fac4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:30.310314 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-699bc666-af23-44f4-a677-b56a7288fac4 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1552 microversion: 2.1 time: 0.246603 Nov 24 16:06:30.311586 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 106/210] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:30 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1552 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:30.424981 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c4dea7e9-e50d-4e9b-a74f-5329415f0a44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:30.426015 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c4dea7e9-e50d-4e9b-a74f-5329415f0a44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:30.433327 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c4dea7e9-e50d-4e9b-a74f-5329415f0a44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:30.433800 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c4dea7e9-e50d-4e9b-a74f-5329415f0a44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:30.434678 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c4dea7e9-e50d-4e9b-a74f-5329415f0a44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:30.435111 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c4dea7e9-e50d-4e9b-a74f-5329415f0a44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:30.537252 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f54426a2-93c9-4a8a-8440-1738a5b6e916 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:30.540112 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f54426a2-93c9-4a8a-8440-1738a5b6e916 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:30.544141 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c4dea7e9-e50d-4e9b-a74f-5329415f0a44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 16319 microversion: 2.20 time: 0.121344 Nov 24 16:06:30.545578 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 105/211] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:30 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 16319 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:30.556248 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f54426a2-93c9-4a8a-8440-1738a5b6e916 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:30.556857 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f54426a2-93c9-4a8a-8440-1738a5b6e916 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:30.557778 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f54426a2-93c9-4a8a-8440-1738a5b6e916 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:30.559269 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f54426a2-93c9-4a8a-8440-1738a5b6e916 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:30.633180 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f54426a2-93c9-4a8a-8440-1738a5b6e916 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 14 microversion: 2.1 time: 0.104788 Nov 24 16:06:30.633880 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 107/212] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:30 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 16:06:31.196449 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0a8d2497-07c1-42b7-9325-0f0552fdedb3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:31.197436 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0a8d2497-07c1-42b7-9325-0f0552fdedb3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:31.208662 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0a8d2497-07c1-42b7-9325-0f0552fdedb3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:31.209756 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0a8d2497-07c1-42b7-9325-0f0552fdedb3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:31.210203 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0a8d2497-07c1-42b7-9325-0f0552fdedb3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:31.210951 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0a8d2497-07c1-42b7-9325-0f0552fdedb3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:31.331630 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-da36c406-d8de-4157-b165-1cae00ec91cb tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:31.332590 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-da36c406-d8de-4157-b165-1cae00ec91cb tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:31.342124 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-da36c406-d8de-4157-b165-1cae00ec91cb tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:31.342854 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-da36c406-d8de-4157-b165-1cae00ec91cb tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:31.343823 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-da36c406-d8de-4157-b165-1cae00ec91cb tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:31.344403 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-da36c406-d8de-4157-b165-1cae00ec91cb tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:31.441168 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0a8d2497-07c1-42b7-9325-0f0552fdedb3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:31.454724 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0a8d2497-07c1-42b7-9325-0f0552fdedb3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.262608 Nov 24 16:06:31.456034 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 106/213] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:31 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:31.558839 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2ccc09d5-d111-4dd7-bb0f-e014922472f5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:31.560751 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2ccc09d5-d111-4dd7-bb0f-e014922472f5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:31.562193 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-da36c406-d8de-4157-b165-1cae00ec91cb tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:31.570763 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-da36c406-d8de-4157-b165-1cae00ec91cb tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1552 microversion: 2.1 time: 0.243217 Nov 24 16:06:31.571043 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2ccc09d5-d111-4dd7-bb0f-e014922472f5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:31.571664 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2ccc09d5-d111-4dd7-bb0f-e014922472f5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:31.572669 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2ccc09d5-d111-4dd7-bb0f-e014922472f5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:31.573247 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2ccc09d5-d111-4dd7-bb0f-e014922472f5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:31.581097 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 108/214] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:31 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1552 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:31.647179 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-bcfbe2f6-0d16-41ab-82cc-31ba24633f5d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:31.648512 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-bcfbe2f6-0d16-41ab-82cc-31ba24633f5d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:31.657804 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bcfbe2f6-0d16-41ab-82cc-31ba24633f5d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:31.658777 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bcfbe2f6-0d16-41ab-82cc-31ba24633f5d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:31.659571 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bcfbe2f6-0d16-41ab-82cc-31ba24633f5d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:31.660011 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bcfbe2f6-0d16-41ab-82cc-31ba24633f5d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:31.706440 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2ccc09d5-d111-4dd7-bb0f-e014922472f5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 17861 microversion: 2.20 time: 0.152840 Nov 24 16:06:31.708616 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 107/215] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:31 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 17861 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:31.778918 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-bcfbe2f6-0d16-41ab-82cc-31ba24633f5d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 14 microversion: 2.1 time: 0.136080 Nov 24 16:06:31.779917 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 109/216] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:31 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 16:06:32.493945 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e7829000-28c2-4912-9eee-44277ea58a59 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:32.498171 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e7829000-28c2-4912-9eee-44277ea58a59 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:32.510741 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e7829000-28c2-4912-9eee-44277ea58a59 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:32.512446 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e7829000-28c2-4912-9eee-44277ea58a59 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:32.513612 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e7829000-28c2-4912-9eee-44277ea58a59 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:32.514125 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e7829000-28c2-4912-9eee-44277ea58a59 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:32.593387 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-162faa18-eb1c-4a70-908c-53781d4b8ee9 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:32.595946 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-162faa18-eb1c-4a70-908c-53781d4b8ee9 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:32.613298 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-162faa18-eb1c-4a70-908c-53781d4b8ee9 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:32.614440 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-162faa18-eb1c-4a70-908c-53781d4b8ee9 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:32.615852 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-162faa18-eb1c-4a70-908c-53781d4b8ee9 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:32.616840 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-162faa18-eb1c-4a70-908c-53781d4b8ee9 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:32.720587 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-162faa18-eb1c-4a70-908c-53781d4b8ee9 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:32.747459 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-162faa18-eb1c-4a70-908c-53781d4b8ee9 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1510 microversion: 2.1 time: 0.162273 Nov 24 16:06:32.753218 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 110/217] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:32 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:32.760504 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-cd53f7bb-cb0e-4cd3-a611-bcdae177182d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:32.763372 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-cd53f7bb-cb0e-4cd3-a611-bcdae177182d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:32.775258 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cd53f7bb-cb0e-4cd3-a611-bcdae177182d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:32.776063 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cd53f7bb-cb0e-4cd3-a611-bcdae177182d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:32.777573 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cd53f7bb-cb0e-4cd3-a611-bcdae177182d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:32.778634 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cd53f7bb-cb0e-4cd3-a611-bcdae177182d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:32.908194 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-cd53f7bb-cb0e-4cd3-a611-bcdae177182d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 18444 microversion: 2.20 time: 0.157017 Nov 24 16:06:32.910873 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 111/218] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:32 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 18444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:32.917010 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-93b84b15-c879-454a-a39c-552a8bc83151 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:32.918127 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-93b84b15-c879-454a-a39c-552a8bc83151 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:32.925552 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-93b84b15-c879-454a-a39c-552a8bc83151 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:32.926260 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-93b84b15-c879-454a-a39c-552a8bc83151 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:32.927124 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-93b84b15-c879-454a-a39c-552a8bc83151 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:32.927623 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-93b84b15-c879-454a-a39c-552a8bc83151 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:33.032089 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-93b84b15-c879-454a-a39c-552a8bc83151 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 6257 microversion: 2.1 time: 0.119247 Nov 24 16:06:33.033431 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 112/219] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:32 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 6257 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:33.041640 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e7829000-28c2-4912-9eee-44277ea58a59 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:33.050811 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-22604d9f-a7ed-4722-9d8a-931d11a395c1 req-3a84d6aa-419c-487b-b355-1bbff0694bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4070b904-d207-48f3-b522-209d11d5291c", "name": "network-vif-deleted", "tag": "af829109-ec6d-4b1f-b501-099d680019fe"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:33.055025 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:06:33.055025 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:06:33.059427 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e7829000-28c2-4912-9eee-44277ea58a59 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.583646 Nov 24 16:06:33.060345 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 108/220] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:32 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:33.066421 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-22604d9f-a7ed-4722-9d8a-931d11a395c1 req-3a84d6aa-419c-487b-b355-1bbff0694bac service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:33.066861 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-22604d9f-a7ed-4722-9d8a-931d11a395c1 req-3a84d6aa-419c-487b-b355-1bbff0694bac service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:33.080512 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-22604d9f-a7ed-4722-9d8a-931d11a395c1 req-3a84d6aa-419c-487b-b355-1bbff0694bac service nova] Creating event network-vif-deleted:af829109-ec6d-4b1f-b501-099d680019fe for instance 4070b904-d207-48f3-b522-209d11d5291c on hv-cinder-81899 Nov 24 16:06:33.087470 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-22604d9f-a7ed-4722-9d8a-931d11a395c1 req-3a84d6aa-419c-487b-b355-1bbff0694bac service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051929 Nov 24 16:06:33.088303 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 113/221] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:06:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:06:33.773124 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a625482d-9a46-4f00-a86c-cd334caa32fa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:33.775323 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a625482d-9a46-4f00-a86c-cd334caa32fa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:33.788485 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a625482d-9a46-4f00-a86c-cd334caa32fa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:33.789800 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a625482d-9a46-4f00-a86c-cd334caa32fa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:33.791544 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a625482d-9a46-4f00-a86c-cd334caa32fa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:33.794049 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a625482d-9a46-4f00-a86c-cd334caa32fa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:33.859744 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a625482d-9a46-4f00-a86c-cd334caa32fa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:33.860560 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a625482d-9a46-4f00-a86c-cd334caa32fa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:33.861416 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-a625482d-9a46-4f00-a86c-cd334caa32fa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lazy-loading 'fault' on Instance uuid 4070b904-d207-48f3-b522-209d11d5291c {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:06:33.929585 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a625482d-9a46-4f00-a86c-cd334caa32fa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4302d75c88647c39a07b19b1bbc9d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c127095ad8cc41098ef0dd79f4fcd589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:33.939613 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ce0b734f-1b5e-4ad9-b989-25351ce8be80 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:33.942227 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ce0b734f-1b5e-4ad9-b989-25351ce8be80 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:33.954784 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a625482d-9a46-4f00-a86c-cd334caa32fa tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 200 len: 1349 microversion: 2.1 time: 0.184040 Nov 24 16:06:33.955869 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ce0b734f-1b5e-4ad9-b989-25351ce8be80 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:33.957215 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ce0b734f-1b5e-4ad9-b989-25351ce8be80 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:33.958921 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ce0b734f-1b5e-4ad9-b989-25351ce8be80 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:33.959662 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ce0b734f-1b5e-4ad9-b989-25351ce8be80 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:33.973164 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 109/222] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:33 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 1349 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:34.047701 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ba6be67a-2772-4dde-98cf-b58fb3299b30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:34.048792 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ba6be67a-2772-4dde-98cf-b58fb3299b30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:34.057112 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ba6be67a-2772-4dde-98cf-b58fb3299b30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:34.057549 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ba6be67a-2772-4dde-98cf-b58fb3299b30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:34.058393 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ba6be67a-2772-4dde-98cf-b58fb3299b30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:34.059175 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ba6be67a-2772-4dde-98cf-b58fb3299b30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:34.145807 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ce0b734f-1b5e-4ad9-b989-25351ce8be80 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 19661 microversion: 2.20 time: 0.227767 Nov 24 16:06:34.147433 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 114/223] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:33 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 19661 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:34.161284 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-bec46944-6ce1-48ee-af5d-fa8669e9aee6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:34.163453 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-bec46944-6ce1-48ee-af5d-fa8669e9aee6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:34.178881 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bec46944-6ce1-48ee-af5d-fa8669e9aee6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:34.180137 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bec46944-6ce1-48ee-af5d-fa8669e9aee6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:34.182597 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bec46944-6ce1-48ee-af5d-fa8669e9aee6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:34.183853 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bec46944-6ce1-48ee-af5d-fa8669e9aee6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:34.235970 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ba6be67a-2772-4dde-98cf-b58fb3299b30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 8058 microversion: 2.1 time: 0.191795 Nov 24 16:06:34.236638 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 110/224] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:34 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 8058 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:34.533104 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-bec46944-6ce1-48ee-af5d-fa8669e9aee6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:34.552908 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-bec46944-6ce1-48ee-af5d-fa8669e9aee6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.402984 Nov 24 16:06:34.553780 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 115/225] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:34 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:34.990229 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d2fc2a24-5798-484b-98c5-e18ee2720714 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:34.991029 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d2fc2a24-5798-484b-98c5-e18ee2720714 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:35.001525 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d2fc2a24-5798-484b-98c5-e18ee2720714 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:35.002859 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d2fc2a24-5798-484b-98c5-e18ee2720714 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:35.003743 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d2fc2a24-5798-484b-98c5-e18ee2720714 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:35.004260 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d2fc2a24-5798-484b-98c5-e18ee2720714 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:35.024412 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-d2fc2a24-5798-484b-98c5-e18ee2720714 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] HTTP exception thrown: Instance 4070b904-d207-48f3-b522-209d11d5291c could not be found. Nov 24 16:06:35.025435 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d2fc2a24-5798-484b-98c5-e18ee2720714 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Returning 404 to user: Instance 4070b904-d207-48f3-b522-209d11d5291c could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:06:35.026608 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d2fc2a24-5798-484b-98c5-e18ee2720714 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 404 len: 111 microversion: 2.1 time: 0.042846 Nov 24 16:06:35.028306 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 111/226] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:34 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 16:06:35.167662 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d9e633d5-f4a6-4f41-856b-0e5ed6cc21b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:35.170361 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d9e633d5-f4a6-4f41-856b-0e5ed6cc21b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:35.180496 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f12e6d78-0cc6-4a88-b123-749efb325257 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:35.182360 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f12e6d78-0cc6-4a88-b123-749efb325257 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:35.183888 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d9e633d5-f4a6-4f41-856b-0e5ed6cc21b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:35.188546 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d9e633d5-f4a6-4f41-856b-0e5ed6cc21b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:35.189961 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d9e633d5-f4a6-4f41-856b-0e5ed6cc21b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:35.194984 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f12e6d78-0cc6-4a88-b123-749efb325257 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:35.195481 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f12e6d78-0cc6-4a88-b123-749efb325257 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:35.196781 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f12e6d78-0cc6-4a88-b123-749efb325257 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:35.197578 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f12e6d78-0cc6-4a88-b123-749efb325257 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:35.208042 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d9e633d5-f4a6-4f41-856b-0e5ed6cc21b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:35.257436 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-f12e6d78-0cc6-4a88-b123-749efb325257 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] HTTP exception thrown: Instance 4070b904-d207-48f3-b522-209d11d5291c could not be found. Nov 24 16:06:35.258052 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f12e6d78-0cc6-4a88-b123-749efb325257 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Returning 404 to user: Instance 4070b904-d207-48f3-b522-209d11d5291c could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:06:35.258907 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f12e6d78-0cc6-4a88-b123-749efb325257 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.088661 Nov 24 16:06:35.259493 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 112/227] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:06:35 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c/os-volume_attachments => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:06:35.271137 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-eb3c9d0f-ccd8-4588-8c37-61779ba379d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:35.272447 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-eb3c9d0f-ccd8-4588-8c37-61779ba379d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:35.280123 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eb3c9d0f-ccd8-4588-8c37-61779ba379d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:35.281054 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eb3c9d0f-ccd8-4588-8c37-61779ba379d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:35.282197 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eb3c9d0f-ccd8-4588-8c37-61779ba379d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:35.282867 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eb3c9d0f-ccd8-4588-8c37-61779ba379d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:35.324365 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d9e633d5-f4a6-4f41-856b-0e5ed6cc21b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 21416 microversion: 2.20 time: 0.166526 Nov 24 16:06:35.325773 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 116/228] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:35 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 21416 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:35.413643 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-eb3c9d0f-ccd8-4588-8c37-61779ba379d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 11929 microversion: 2.1 time: 0.146553 Nov 24 16:06:35.414800 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 113/229] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:35 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 11929 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:35.578892 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b6b704c0-2fe4-41e8-928d-d6d7c651d4b0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:35.579756 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b6b704c0-2fe4-41e8-928d-d6d7c651d4b0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:35.595743 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b6b704c0-2fe4-41e8-928d-d6d7c651d4b0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:35.596325 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b6b704c0-2fe4-41e8-928d-d6d7c651d4b0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:35.597266 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b6b704c0-2fe4-41e8-928d-d6d7c651d4b0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:35.598330 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b6b704c0-2fe4-41e8-928d-d6d7c651d4b0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:35.762259 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-646642297", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "networks": [{"uuid": "fafb4435-765d-4616-9638-8248f7ef836b"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:35.790999 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b6b704c0-2fe4-41e8-928d-d6d7c651d4b0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:35.803265 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b6b704c0-2fe4-41e8-928d-d6d7c651d4b0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.229704 Nov 24 16:06:35.812313 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 117/230] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:35 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:35.843505 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] validate_networks() for [('fafb4435-765d-4616-9638-8248f7ef836b', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:06:36.341788 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3bcaca9e-12e4-4a67-8f8e-4064448f5a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:36.343869 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3bcaca9e-12e4-4a67-8f8e-4064448f5a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:36.360787 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3bcaca9e-12e4-4a67-8f8e-4064448f5a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:36.361408 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3bcaca9e-12e4-4a67-8f8e-4064448f5a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:36.362296 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3bcaca9e-12e4-4a67-8f8e-4064448f5a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:36.362950 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3bcaca9e-12e4-4a67-8f8e-4064448f5a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:36.461869 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3bcaca9e-12e4-4a67-8f8e-4064448f5a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 22589 microversion: 2.20 time: 0.125177 Nov 24 16:06:36.463109 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 118/231] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:36 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 22589 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:06:36.474785 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d38d0bbd-cf0d-475a-9cc1-a551c12cf9fd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:36.475974 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d38d0bbd-cf0d-475a-9cc1-a551c12cf9fd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:36.491681 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d38d0bbd-cf0d-475a-9cc1-a551c12cf9fd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:36.491884 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d38d0bbd-cf0d-475a-9cc1-a551c12cf9fd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:36.501352 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d38d0bbd-cf0d-475a-9cc1-a551c12cf9fd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:36.501999 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d38d0bbd-cf0d-475a-9cc1-a551c12cf9fd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:36.579807 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:06:36.581421 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:06:36.582024 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:06:36.582962 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:06:36.583579 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:06:36.601464 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:36.602855 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:36.604522 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:36.606203 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:36.644161 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Getting quotas for project 20c9176ab8ef44ffb17eda5f41aca2a8. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:06:36.657207 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d38d0bbd-cf0d-475a-9cc1-a551c12cf9fd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 15064 microversion: 2.1 time: 0.191825 Nov 24 16:06:36.658155 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 119/232] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:36 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 15064 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:36.659755 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Getting quotas for user 9fe7f58143cd4ee2bc161e220fbbbd12 and project 20c9176ab8ef44ffb17eda5f41aca2a8. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:06:36.664239 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-28b3b4ea-2ea3-4d34-9752-3ce194719876 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:36.665056 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-28b3b4ea-2ea3-4d34-9752-3ce194719876 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:36.674366 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-28b3b4ea-2ea3-4d34-9752-3ce194719876 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:36.675010 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-28b3b4ea-2ea3-4d34-9752-3ce194719876 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:36.676137 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-28b3b4ea-2ea3-4d34-9752-3ce194719876 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:36.676596 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-28b3b4ea-2ea3-4d34-9752-3ce194719876 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:36.682334 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:06:36.687159 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:06:36.698898 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-28b3b4ea-2ea3-4d34-9752-3ce194719876 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] HTTP exception thrown: Instance 4070b904-d207-48f3-b522-209d11d5291c could not be found. Nov 24 16:06:36.699554 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-28b3b4ea-2ea3-4d34-9752-3ce194719876 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Returning 404 to user: Instance 4070b904-d207-48f3-b522-209d11d5291c could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:06:36.700503 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-28b3b4ea-2ea3-4d34-9752-3ce194719876 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 404 len: 111 microversion: 2.1 time: 0.040670 Nov 24 16:06:36.701467 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 120/233] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:06:36 2021] DELETE /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:06:36.712453 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3c93c712-ee55-41c1-9464-aa67eac91331 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:36.713654 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3c93c712-ee55-41c1-9464-aa67eac91331 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] [instance: 4070b904-d207-48f3-b522-209d11d5291c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:36.721846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3c93c712-ee55-41c1-9464-aa67eac91331 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:36.722614 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3c93c712-ee55-41c1-9464-aa67eac91331 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:36.723874 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3c93c712-ee55-41c1-9464-aa67eac91331 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:36.724456 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3c93c712-ee55-41c1-9464-aa67eac91331 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:36.767499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-3c93c712-ee55-41c1-9464-aa67eac91331 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] HTTP exception thrown: Instance 4070b904-d207-48f3-b522-209d11d5291c could not be found. Nov 24 16:06:36.769510 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-172973d2-e069-4965-8818-20e4662bd3e2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.011677 Nov 24 16:06:36.770114 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3c93c712-ee55-41c1-9464-aa67eac91331 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] Returning 404 to user: Instance 4070b904-d207-48f3-b522-209d11d5291c could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:06:36.771346 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3c93c712-ee55-41c1-9464-aa67eac91331 tempest-DeleteServersTestJSON-739900791 tempest-DeleteServersTestJSON-739900791-project] 10.222.0.72 "GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c" status: 404 len: 111 microversion: 2.1 time: 0.064053 Nov 24 16:06:36.772302 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 114/234] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:06:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:06:36.778705 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 121/235] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:36 2021] GET /compute/v2.1/servers/4070b904-d207-48f3-b522-209d11d5291c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:06:36.783895 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6ca44cc4-0b76-4a6a-90fe-0cd36cc90f32 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:36.784512 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6ca44cc4-0b76-4a6a-90fe-0cd36cc90f32 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:36.827848 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8d17f8b5-75d3-46f7-98e2-4f3d70e8b4ea tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:36.828579 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8d17f8b5-75d3-46f7-98e2-4f3d70e8b4ea tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:36.838102 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8d17f8b5-75d3-46f7-98e2-4f3d70e8b4ea tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:36.839945 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8d17f8b5-75d3-46f7-98e2-4f3d70e8b4ea tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:36.841154 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8d17f8b5-75d3-46f7-98e2-4f3d70e8b4ea tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:36.842954 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8d17f8b5-75d3-46f7-98e2-4f3d70e8b4ea tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:36.936179 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6ca44cc4-0b76-4a6a-90fe-0cd36cc90f32 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:36.947198 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6ca44cc4-0b76-4a6a-90fe-0cd36cc90f32 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1217 microversion: 2.1 time: 0.167319 Nov 24 16:06:36.958825 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 115/236] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:36 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:37.140433 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8d17f8b5-75d3-46f7-98e2-4f3d70e8b4ea tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:37.152636 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8d17f8b5-75d3-46f7-98e2-4f3d70e8b4ea tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.328460 Nov 24 16:06:37.154165 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 122/237] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:36 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:37.476313 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b6c8fdb3-36a1-43d9-a8f3-91e0289a5af0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:37.477947 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b6c8fdb3-36a1-43d9-a8f3-91e0289a5af0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:37.496992 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b6c8fdb3-36a1-43d9-a8f3-91e0289a5af0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:37.497442 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b6c8fdb3-36a1-43d9-a8f3-91e0289a5af0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:37.498265 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b6c8fdb3-36a1-43d9-a8f3-91e0289a5af0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:37.504974 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b6c8fdb3-36a1-43d9-a8f3-91e0289a5af0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:37.644749 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b6c8fdb3-36a1-43d9-a8f3-91e0289a5af0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 23225 microversion: 2.20 time: 0.172473 Nov 24 16:06:37.645537 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 116/238] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:37 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 23225 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:37.682717 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-78812944-b81f-4487-9120-949ce54ffdf4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:37.685940 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-78812944-b81f-4487-9120-949ce54ffdf4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:37.698230 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-78812944-b81f-4487-9120-949ce54ffdf4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:37.699090 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-78812944-b81f-4487-9120-949ce54ffdf4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:37.701305 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-78812944-b81f-4487-9120-949ce54ffdf4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:37.703213 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-78812944-b81f-4487-9120-949ce54ffdf4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:37.880981 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-78812944-b81f-4487-9120-949ce54ffdf4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 17659 microversion: 2.1 time: 0.211758 Nov 24 16:06:37.885265 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 123/239] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:37 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 17659 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:37.972094 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-98383a38-06ef-468a-9376-7e601af7d52e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:37.973670 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-98383a38-06ef-468a-9376-7e601af7d52e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:37.985642 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-98383a38-06ef-468a-9376-7e601af7d52e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:37.986172 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-98383a38-06ef-468a-9376-7e601af7d52e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:37.987317 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-98383a38-06ef-468a-9376-7e601af7d52e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:37.988156 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-98383a38-06ef-468a-9376-7e601af7d52e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:38.106368 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-98383a38-06ef-468a-9376-7e601af7d52e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:38.116419 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-98383a38-06ef-468a-9376-7e601af7d52e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1269 microversion: 2.1 time: 0.152169 Nov 24 16:06:38.117661 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 117/240] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:37 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:38.194165 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-40c9de70-d011-41f8-b962-306f4c962148 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:38.195987 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-40c9de70-d011-41f8-b962-306f4c962148 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:38.213051 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-40c9de70-d011-41f8-b962-306f4c962148 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:38.213051 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-40c9de70-d011-41f8-b962-306f4c962148 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:38.213409 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-40c9de70-d011-41f8-b962-306f4c962148 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:38.213864 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-40c9de70-d011-41f8-b962-306f4c962148 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:38.488564 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-40c9de70-d011-41f8-b962-306f4c962148 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:38.506194 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-40c9de70-d011-41f8-b962-306f4c962148 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.335234 Nov 24 16:06:38.507141 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 124/241] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:38 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:38.662820 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-557dae63-f717-4a5a-9932-ebd4a8576bac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:38.665102 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-557dae63-f717-4a5a-9932-ebd4a8576bac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:38.682882 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-557dae63-f717-4a5a-9932-ebd4a8576bac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:38.684332 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-557dae63-f717-4a5a-9932-ebd4a8576bac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:38.686104 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-557dae63-f717-4a5a-9932-ebd4a8576bac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:38.687107 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-557dae63-f717-4a5a-9932-ebd4a8576bac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:38.798346 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-557dae63-f717-4a5a-9932-ebd4a8576bac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 23989 microversion: 2.20 time: 0.142449 Nov 24 16:06:38.799018 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 118/242] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:38 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 23989 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:38.900435 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fea18c9f-b583-4b90-9897-5b0181f9a343 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:38.902890 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fea18c9f-b583-4b90-9897-5b0181f9a343 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:38.930275 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fea18c9f-b583-4b90-9897-5b0181f9a343 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:38.931441 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fea18c9f-b583-4b90-9897-5b0181f9a343 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:38.935579 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fea18c9f-b583-4b90-9897-5b0181f9a343 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:38.937280 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fea18c9f-b583-4b90-9897-5b0181f9a343 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:39.083765 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fea18c9f-b583-4b90-9897-5b0181f9a343 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 17686 microversion: 2.1 time: 0.192985 Nov 24 16:06:39.087883 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 125/243] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:38 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 17686 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:39.139769 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-35436a09-4200-4893-aa21-bfd0bf5b5a63 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:39.140931 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-35436a09-4200-4893-aa21-bfd0bf5b5a63 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:39.162072 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-35436a09-4200-4893-aa21-bfd0bf5b5a63 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:39.163232 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-35436a09-4200-4893-aa21-bfd0bf5b5a63 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:39.164967 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-35436a09-4200-4893-aa21-bfd0bf5b5a63 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:39.166061 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-35436a09-4200-4893-aa21-bfd0bf5b5a63 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:39.336072 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-35436a09-4200-4893-aa21-bfd0bf5b5a63 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:39.349562 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-35436a09-4200-4893-aa21-bfd0bf5b5a63 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1275 microversion: 2.1 time: 0.214248 Nov 24 16:06:39.351525 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 119/244] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:39 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1275 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:39.526160 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a950d59d-811f-44d7-a7b5-e519540a753b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:39.527890 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a950d59d-811f-44d7-a7b5-e519540a753b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:39.542253 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a950d59d-811f-44d7-a7b5-e519540a753b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:39.546464 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a950d59d-811f-44d7-a7b5-e519540a753b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:39.550372 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a950d59d-811f-44d7-a7b5-e519540a753b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:39.551116 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a950d59d-811f-44d7-a7b5-e519540a753b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:39.803147 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a950d59d-811f-44d7-a7b5-e519540a753b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:39.811482 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b1bc2ea5-fc6a-4304-a04b-8def82a95266 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:39.813129 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b1bc2ea5-fc6a-4304-a04b-8def82a95266 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:39.816579 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a950d59d-811f-44d7-a7b5-e519540a753b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.294960 Nov 24 16:06:39.817629 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 126/245] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:39 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:39.820609 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1bc2ea5-fc6a-4304-a04b-8def82a95266 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:39.821099 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1bc2ea5-fc6a-4304-a04b-8def82a95266 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:39.822156 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1bc2ea5-fc6a-4304-a04b-8def82a95266 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:39.822752 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1bc2ea5-fc6a-4304-a04b-8def82a95266 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:39.933808 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b1bc2ea5-fc6a-4304-a04b-8def82a95266 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 24841 microversion: 2.20 time: 0.125810 Nov 24 16:06:39.936467 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 120/246] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:39 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 24841 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:40.099893 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b7011aa9-2ce7-4ebd-88d2-b06c60269b47 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:40.101081 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b7011aa9-2ce7-4ebd-88d2-b06c60269b47 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:40.109149 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b7011aa9-2ce7-4ebd-88d2-b06c60269b47 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:40.109609 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b7011aa9-2ce7-4ebd-88d2-b06c60269b47 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:40.110426 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b7011aa9-2ce7-4ebd-88d2-b06c60269b47 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:40.110862 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b7011aa9-2ce7-4ebd-88d2-b06c60269b47 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:40.205740 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b7011aa9-2ce7-4ebd-88d2-b06c60269b47 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 19342 microversion: 2.1 time: 0.109113 Nov 24 16:06:40.217806 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 127/247] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:40 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 19342 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:06:40.373900 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3c706555-7581-4ee3-bb60-5731e4e50c60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:40.375012 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3c706555-7581-4ee3-bb60-5731e4e50c60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:40.386497 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3c706555-7581-4ee3-bb60-5731e4e50c60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:40.387311 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3c706555-7581-4ee3-bb60-5731e4e50c60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:40.388357 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3c706555-7581-4ee3-bb60-5731e4e50c60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:40.389103 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3c706555-7581-4ee3-bb60-5731e4e50c60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:40.532729 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-8752c753-6812-4bc9-b948-c2024a206016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dbe3561-9e63-4d04-9c0f-563b85fa743f", "tag": "3fa4f539-3c48-40d2-a56f-0717a9dc7259"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:40.537314 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:06:40.537314 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:06:40.563120 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-8752c753-6812-4bc9-b948-c2024a206016 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:40.564767 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-8752c753-6812-4bc9-b948-c2024a206016 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:40.599695 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-8752c753-6812-4bc9-b948-c2024a206016 service nova] Creating event network-changed:3fa4f539-3c48-40d2-a56f-0717a9dc7259 for instance 5dbe3561-9e63-4d04-9c0f-563b85fa743f on hv-cinder-81899 Nov 24 16:06:40.617732 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-732d9a5d-ce83-4e95-9be9-2225322a8c7b req-8752c753-6812-4bc9-b948-c2024a206016 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093822 Nov 24 16:06:40.619760 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 128/248] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:06:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:06:40.736559 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3c706555-7581-4ee3-bb60-5731e4e50c60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:40.751214 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3c706555-7581-4ee3-bb60-5731e4e50c60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1317 microversion: 2.1 time: 0.385117 Nov 24 16:06:40.751963 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 121/249] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:40 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:40.844399 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-24c62133-9e0d-4198-bf2e-f7e1b38033de tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:40.847138 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-24c62133-9e0d-4198-bf2e-f7e1b38033de tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:40.880109 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-24c62133-9e0d-4198-bf2e-f7e1b38033de tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:40.880967 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-24c62133-9e0d-4198-bf2e-f7e1b38033de tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:40.882405 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-24c62133-9e0d-4198-bf2e-f7e1b38033de tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:40.883142 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-24c62133-9e0d-4198-bf2e-f7e1b38033de tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:40.953620 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0eb9cad3-a56c-44b9-b880-5bda14c42d92 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:40.955422 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0eb9cad3-a56c-44b9-b880-5bda14c42d92 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:40.975213 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0eb9cad3-a56c-44b9-b880-5bda14c42d92 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:40.975845 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0eb9cad3-a56c-44b9-b880-5bda14c42d92 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:40.976780 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0eb9cad3-a56c-44b9-b880-5bda14c42d92 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:40.977528 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0eb9cad3-a56c-44b9-b880-5bda14c42d92 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:41.091467 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0eb9cad3-a56c-44b9-b880-5bda14c42d92 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 25849 microversion: 2.20 time: 0.147102 Nov 24 16:06:41.096164 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 122/250] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:40 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 25849 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:06:41.131845 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-24c62133-9e0d-4198-bf2e-f7e1b38033de tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:41.142267 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-24c62133-9e0d-4198-bf2e-f7e1b38033de tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.306443 Nov 24 16:06:41.142602 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 129/251] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:40 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:41.236430 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0439a821-0a31-48e3-8d29-6015d4f5b24c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:41.237606 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0439a821-0a31-48e3-8d29-6015d4f5b24c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:41.262261 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0439a821-0a31-48e3-8d29-6015d4f5b24c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:41.265721 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0439a821-0a31-48e3-8d29-6015d4f5b24c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:41.267586 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0439a821-0a31-48e3-8d29-6015d4f5b24c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:41.269265 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0439a821-0a31-48e3-8d29-6015d4f5b24c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:41.383478 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0439a821-0a31-48e3-8d29-6015d4f5b24c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 21616 microversion: 2.1 time: 0.150448 Nov 24 16:06:41.385385 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 123/252] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:41 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 21616 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:41.774849 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-db6b4e5a-b737-4ad3-bdbc-a2dd3e668aeb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:41.775875 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-db6b4e5a-b737-4ad3-bdbc-a2dd3e668aeb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:41.785114 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-db6b4e5a-b737-4ad3-bdbc-a2dd3e668aeb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:41.786194 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-db6b4e5a-b737-4ad3-bdbc-a2dd3e668aeb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:41.787201 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-db6b4e5a-b737-4ad3-bdbc-a2dd3e668aeb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:41.787811 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-db6b4e5a-b737-4ad3-bdbc-a2dd3e668aeb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:42.020205 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-db6b4e5a-b737-4ad3-bdbc-a2dd3e668aeb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:42.053306 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-db6b4e5a-b737-4ad3-bdbc-a2dd3e668aeb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1317 microversion: 2.1 time: 0.282910 Nov 24 16:06:42.057062 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 130/253] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:41 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:42.110566 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fd61e37a-617b-4fc8-9ebe-a5c48eb53b77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:42.112372 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fd61e37a-617b-4fc8-9ebe-a5c48eb53b77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:42.126944 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd61e37a-617b-4fc8-9ebe-a5c48eb53b77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:42.127685 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd61e37a-617b-4fc8-9ebe-a5c48eb53b77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:42.129411 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd61e37a-617b-4fc8-9ebe-a5c48eb53b77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:42.130439 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd61e37a-617b-4fc8-9ebe-a5c48eb53b77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:42.163945 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8c120077-b672-475c-9675-bdf6d00c9d71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:42.173306 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8c120077-b672-475c-9675-bdf6d00c9d71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:42.194018 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c120077-b672-475c-9675-bdf6d00c9d71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:42.194782 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c120077-b672-475c-9675-bdf6d00c9d71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:42.196180 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c120077-b672-475c-9675-bdf6d00c9d71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:42.201228 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c120077-b672-475c-9675-bdf6d00c9d71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:42.425904 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fd61e37a-617b-4fc8-9ebe-a5c48eb53b77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 26938 microversion: 2.20 time: 0.324127 Nov 24 16:06:42.426993 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 124/254] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:42 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 26938 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:42.438571 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-db3ffa34-8b2e-4ffc-9772-dc1040bdaf7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:42.440548 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-db3ffa34-8b2e-4ffc-9772-dc1040bdaf7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:42.454209 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-db3ffa34-8b2e-4ffc-9772-dc1040bdaf7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:42.454668 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-db3ffa34-8b2e-4ffc-9772-dc1040bdaf7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:42.455493 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-db3ffa34-8b2e-4ffc-9772-dc1040bdaf7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:42.455942 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-db3ffa34-8b2e-4ffc-9772-dc1040bdaf7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:42.520872 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8c120077-b672-475c-9675-bdf6d00c9d71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:42.533931 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8c120077-b672-475c-9675-bdf6d00c9d71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.376376 Nov 24 16:06:42.535603 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 131/255] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:42 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:42.554279 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-db3ffa34-8b2e-4ffc-9772-dc1040bdaf7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 22973 microversion: 2.1 time: 0.124041 Nov 24 16:06:42.557094 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 125/256] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:42 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 22973 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:43.077545 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-335f03df-0a19-4bfb-bd6b-db81c5cd5a6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:43.078609 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-335f03df-0a19-4bfb-bd6b-db81c5cd5a6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:43.085755 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-335f03df-0a19-4bfb-bd6b-db81c5cd5a6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:43.086814 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-335f03df-0a19-4bfb-bd6b-db81c5cd5a6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:43.087466 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-335f03df-0a19-4bfb-bd6b-db81c5cd5a6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:43.088137 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-335f03df-0a19-4bfb-bd6b-db81c5cd5a6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:43.300674 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-335f03df-0a19-4bfb-bd6b-db81c5cd5a6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:43.308661 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-335f03df-0a19-4bfb-bd6b-db81c5cd5a6a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1317 microversion: 2.1 time: 0.236282 Nov 24 16:06:43.318776 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 132/257] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:43 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:43.442265 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ba2e487b-690e-4fcb-8dc9-0a56f444279a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:43.443215 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ba2e487b-690e-4fcb-8dc9-0a56f444279a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:43.451212 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ba2e487b-690e-4fcb-8dc9-0a56f444279a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:43.451670 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ba2e487b-690e-4fcb-8dc9-0a56f444279a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:43.452475 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ba2e487b-690e-4fcb-8dc9-0a56f444279a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:43.452913 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ba2e487b-690e-4fcb-8dc9-0a56f444279a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:43.552240 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2ebb09e2-30e9-4e85-9187-e03cb4bfaa7b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:43.552841 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2ebb09e2-30e9-4e85-9187-e03cb4bfaa7b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:43.560155 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ebb09e2-30e9-4e85-9187-e03cb4bfaa7b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:43.560607 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ebb09e2-30e9-4e85-9187-e03cb4bfaa7b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:43.561425 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ebb09e2-30e9-4e85-9187-e03cb4bfaa7b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:43.561899 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ebb09e2-30e9-4e85-9187-e03cb4bfaa7b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:43.588349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ba2e487b-690e-4fcb-8dc9-0a56f444279a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 27401 microversion: 2.20 time: 0.150449 Nov 24 16:06:43.589778 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 126/258] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:43 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 27401 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:06:43.598866 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d26f0a29-7cb6-4bf6-b717-429e3adb8729 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:43.599933 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d26f0a29-7cb6-4bf6-b717-429e3adb8729 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:43.607946 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d26f0a29-7cb6-4bf6-b717-429e3adb8729 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:43.608390 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d26f0a29-7cb6-4bf6-b717-429e3adb8729 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:43.610133 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d26f0a29-7cb6-4bf6-b717-429e3adb8729 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:43.610133 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d26f0a29-7cb6-4bf6-b717-429e3adb8729 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:43.735106 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d26f0a29-7cb6-4bf6-b717-429e3adb8729 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 23878 microversion: 2.1 time: 0.143606 Nov 24 16:06:43.735768 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 127/259] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:43 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 23878 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:43.739790 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-2ebb09e2-30e9-4e85-9187-e03cb4bfaa7b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:43.748675 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2ebb09e2-30e9-4e85-9187-e03cb4bfaa7b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.200136 Nov 24 16:06:43.749308 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 133/260] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:43 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:44.326628 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-34fe11ff-f33b-4784-9003-f6823807306f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:44.327322 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-34fe11ff-f33b-4784-9003-f6823807306f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:44.334699 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-34fe11ff-f33b-4784-9003-f6823807306f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:44.335146 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-34fe11ff-f33b-4784-9003-f6823807306f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:44.335949 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-34fe11ff-f33b-4784-9003-f6823807306f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:44.336385 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-34fe11ff-f33b-4784-9003-f6823807306f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:44.489941 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-34fe11ff-f33b-4784-9003-f6823807306f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:44.499263 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-34fe11ff-f33b-4784-9003-f6823807306f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1317 microversion: 2.1 time: 0.176850 Nov 24 16:06:44.499864 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 128/261] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:44 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:44.601540 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ef670833-edbc-413d-9871-db1f7857eb25 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:44.602533 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ef670833-edbc-413d-9871-db1f7857eb25 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:44.611159 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ef670833-edbc-413d-9871-db1f7857eb25 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:44.611610 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ef670833-edbc-413d-9871-db1f7857eb25 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:44.612419 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ef670833-edbc-413d-9871-db1f7857eb25 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:44.612891 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ef670833-edbc-413d-9871-db1f7857eb25 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:44.723886 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ef670833-edbc-413d-9871-db1f7857eb25 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 27621 microversion: 2.20 time: 0.125890 Nov 24 16:06:44.724735 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 134/262] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:44 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 27621 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:44.747958 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a9624b17-cbef-46db-be04-d78b4bdaa470 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:44.748908 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a9624b17-cbef-46db-be04-d78b4bdaa470 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:44.756190 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a9624b17-cbef-46db-be04-d78b4bdaa470 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:44.756668 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a9624b17-cbef-46db-be04-d78b4bdaa470 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:44.757517 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a9624b17-cbef-46db-be04-d78b4bdaa470 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:44.757955 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a9624b17-cbef-46db-be04-d78b4bdaa470 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:44.767461 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f2f229ee-d370-43e0-9d6f-81bfaba414fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:44.768346 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f2f229ee-d370-43e0-9d6f-81bfaba414fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:44.776011 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f2f229ee-d370-43e0-9d6f-81bfaba414fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:44.777284 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f2f229ee-d370-43e0-9d6f-81bfaba414fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:44.778436 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f2f229ee-d370-43e0-9d6f-81bfaba414fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:44.778879 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f2f229ee-d370-43e0-9d6f-81bfaba414fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:44.859603 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a9624b17-cbef-46db-be04-d78b4bdaa470 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 24948 microversion: 2.1 time: 0.116541 Nov 24 16:06:44.863654 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 129/263] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:44 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 24948 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:44.927054 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-f2f229ee-d370-43e0-9d6f-81bfaba414fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:44.934969 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f2f229ee-d370-43e0-9d6f-81bfaba414fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.171545 Nov 24 16:06:44.935547 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 135/264] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:44 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:45.521273 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a2abfc2c-256c-4490-ba66-1d7d17142f37 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:45.521273 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a2abfc2c-256c-4490-ba66-1d7d17142f37 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:45.525482 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a2abfc2c-256c-4490-ba66-1d7d17142f37 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:45.525935 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a2abfc2c-256c-4490-ba66-1d7d17142f37 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:45.526787 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a2abfc2c-256c-4490-ba66-1d7d17142f37 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:45.527229 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a2abfc2c-256c-4490-ba66-1d7d17142f37 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:45.685622 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a2abfc2c-256c-4490-ba66-1d7d17142f37 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:45.694839 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a2abfc2c-256c-4490-ba66-1d7d17142f37 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1317 microversion: 2.1 time: 0.179751 Nov 24 16:06:45.694839 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 130/265] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:45 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:45.738645 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fcd052e6-eb30-4488-9313-8b85bc305b13 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:45.739576 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fcd052e6-eb30-4488-9313-8b85bc305b13 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:45.762523 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fcd052e6-eb30-4488-9313-8b85bc305b13 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:45.762972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fcd052e6-eb30-4488-9313-8b85bc305b13 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:45.763789 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fcd052e6-eb30-4488-9313-8b85bc305b13 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:45.764400 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fcd052e6-eb30-4488-9313-8b85bc305b13 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:45.871704 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4aaaf8d5-0b27-4fca-9e5a-0b933292c3a3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:45.872633 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4aaaf8d5-0b27-4fca-9e5a-0b933292c3a3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:45.875146 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fcd052e6-eb30-4488-9313-8b85bc305b13 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 27867 microversion: 2.20 time: 0.140518 Nov 24 16:06:45.880532 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 136/266] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:45 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 27867 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:45.880816 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4aaaf8d5-0b27-4fca-9e5a-0b933292c3a3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:45.881067 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4aaaf8d5-0b27-4fca-9e5a-0b933292c3a3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:45.881878 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4aaaf8d5-0b27-4fca-9e5a-0b933292c3a3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:45.882508 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4aaaf8d5-0b27-4fca-9e5a-0b933292c3a3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:45.953377 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2ccfa6e1-548b-47aa-9554-1f7306d0a3fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:45.954073 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2ccfa6e1-548b-47aa-9554-1f7306d0a3fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:45.960909 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ccfa6e1-548b-47aa-9554-1f7306d0a3fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:45.961400 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ccfa6e1-548b-47aa-9554-1f7306d0a3fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:45.962405 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ccfa6e1-548b-47aa-9554-1f7306d0a3fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:45.962844 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ccfa6e1-548b-47aa-9554-1f7306d0a3fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:45.978148 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4aaaf8d5-0b27-4fca-9e5a-0b933292c3a3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 25839 microversion: 2.1 time: 0.110183 Nov 24 16:06:45.978952 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 131/267] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:45 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 25839 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:46.133697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-2ccfa6e1-548b-47aa-9554-1f7306d0a3fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:46.148075 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2ccfa6e1-548b-47aa-9554-1f7306d0a3fe tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.198272 Nov 24 16:06:46.149267 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 137/268] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:45 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:46.711205 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d63e403a-17c8-4e90-9870-6926ef28696f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:46.712176 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d63e403a-17c8-4e90-9870-6926ef28696f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:46.722038 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d63e403a-17c8-4e90-9870-6926ef28696f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:46.722385 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d63e403a-17c8-4e90-9870-6926ef28696f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:46.723381 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d63e403a-17c8-4e90-9870-6926ef28696f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:46.723812 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d63e403a-17c8-4e90-9870-6926ef28696f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:46.885717 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d63e403a-17c8-4e90-9870-6926ef28696f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:46.888154 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-70a9d9d5-cbce-4753-a7c1-b2a09d36e4ad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:46.889303 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-70a9d9d5-cbce-4753-a7c1-b2a09d36e4ad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:46.895293 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d63e403a-17c8-4e90-9870-6926ef28696f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1317 microversion: 2.1 time: 0.188181 Nov 24 16:06:46.895529 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-70a9d9d5-cbce-4753-a7c1-b2a09d36e4ad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:46.895948 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-70a9d9d5-cbce-4753-a7c1-b2a09d36e4ad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:46.896625 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 132/269] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:46 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:46.896736 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-70a9d9d5-cbce-4753-a7c1-b2a09d36e4ad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:46.897205 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-70a9d9d5-cbce-4753-a7c1-b2a09d36e4ad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:46.995548 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b1907918-ca71-43d8-8b2e-25f80d2567d7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:46.996923 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b1907918-ca71-43d8-8b2e-25f80d2567d7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:47.007084 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1907918-ca71-43d8-8b2e-25f80d2567d7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:47.007906 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1907918-ca71-43d8-8b2e-25f80d2567d7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:47.008939 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1907918-ca71-43d8-8b2e-25f80d2567d7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:47.009622 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1907918-ca71-43d8-8b2e-25f80d2567d7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:47.011352 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-70a9d9d5-cbce-4753-a7c1-b2a09d36e4ad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 27945 microversion: 2.20 time: 0.126649 Nov 24 16:06:47.012565 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 138/270] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:46 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 27945 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:47.125425 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b1907918-ca71-43d8-8b2e-25f80d2567d7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 26750 microversion: 2.1 time: 0.135728 Nov 24 16:06:47.127169 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 133/271] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:46 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 26750 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:06:47.171582 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2f13629e-9fce-466a-9c7b-0d95e9e1e2eb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:47.172282 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2f13629e-9fce-466a-9c7b-0d95e9e1e2eb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:47.185072 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2f13629e-9fce-466a-9c7b-0d95e9e1e2eb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:47.185675 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2f13629e-9fce-466a-9c7b-0d95e9e1e2eb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:47.186327 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2f13629e-9fce-466a-9c7b-0d95e9e1e2eb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:47.186769 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2f13629e-9fce-466a-9c7b-0d95e9e1e2eb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:47.351084 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-2f13629e-9fce-466a-9c7b-0d95e9e1e2eb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:47.360122 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2f13629e-9fce-466a-9c7b-0d95e9e1e2eb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.193035 Nov 24 16:06:47.360750 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 139/272] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:47 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:47.919750 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-514f9e44-6be3-4ca0-bb65-ad862f56e997 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:47.921263 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-514f9e44-6be3-4ca0-bb65-ad862f56e997 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:47.934942 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-514f9e44-6be3-4ca0-bb65-ad862f56e997 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:47.935746 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-514f9e44-6be3-4ca0-bb65-ad862f56e997 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:47.937582 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-514f9e44-6be3-4ca0-bb65-ad862f56e997 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:47.938494 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-514f9e44-6be3-4ca0-bb65-ad862f56e997 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:48.024475 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-113e881d-ae2e-40d1-b35b-2258651936ac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:48.025131 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-113e881d-ae2e-40d1-b35b-2258651936ac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:48.041153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-113e881d-ae2e-40d1-b35b-2258651936ac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:48.041662 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-113e881d-ae2e-40d1-b35b-2258651936ac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:48.042992 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-113e881d-ae2e-40d1-b35b-2258651936ac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:48.043481 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-113e881d-ae2e-40d1-b35b-2258651936ac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:48.161295 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-514f9e44-6be3-4ca0-bb65-ad862f56e997 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:48.169961 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-514f9e44-6be3-4ca0-bb65-ad862f56e997 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1317 microversion: 2.1 time: 0.258265 Nov 24 16:06:48.172530 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-113e881d-ae2e-40d1-b35b-2258651936ac tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.152747 Nov 24 16:06:48.173689 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 140/273] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:48 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:06:48.174389 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 134/274] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:47 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:48.180686 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2ba7dbcf-4d91-4c42-92e7-0c9894052cba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:48.181917 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2ba7dbcf-4d91-4c42-92e7-0c9894052cba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:48.201297 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ba7dbcf-4d91-4c42-92e7-0c9894052cba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:48.202066 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ba7dbcf-4d91-4c42-92e7-0c9894052cba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:48.203087 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ba7dbcf-4d91-4c42-92e7-0c9894052cba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:48.203722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ba7dbcf-4d91-4c42-92e7-0c9894052cba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:48.315847 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2ba7dbcf-4d91-4c42-92e7-0c9894052cba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 27251 microversion: 2.1 time: 0.140055 Nov 24 16:06:48.317160 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 141/275] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:48 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 27251 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:48.383204 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bbea0043-ae83-41f5-adf4-bdbd4853f770 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:48.384114 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bbea0043-ae83-41f5-adf4-bdbd4853f770 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:48.396703 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bbea0043-ae83-41f5-adf4-bdbd4853f770 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:48.397886 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bbea0043-ae83-41f5-adf4-bdbd4853f770 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:48.399853 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bbea0043-ae83-41f5-adf4-bdbd4853f770 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:48.400671 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bbea0043-ae83-41f5-adf4-bdbd4853f770 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:48.631620 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bbea0043-ae83-41f5-adf4-bdbd4853f770 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:48.641850 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bbea0043-ae83-41f5-adf4-bdbd4853f770 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.266280 Nov 24 16:06:48.653672 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 135/276] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:48 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:49.212094 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ca5bc1b6-0041-49fc-9e63-0002b65bfa27 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:49.212927 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-30d241d8-16dd-400a-8616-27d3a3dfd50c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:49.216037 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ca5bc1b6-0041-49fc-9e63-0002b65bfa27 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:49.219495 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-30d241d8-16dd-400a-8616-27d3a3dfd50c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:49.230131 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ca5bc1b6-0041-49fc-9e63-0002b65bfa27 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:49.234961 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-30d241d8-16dd-400a-8616-27d3a3dfd50c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:49.235635 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ca5bc1b6-0041-49fc-9e63-0002b65bfa27 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:49.236654 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ca5bc1b6-0041-49fc-9e63-0002b65bfa27 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:49.237419 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ca5bc1b6-0041-49fc-9e63-0002b65bfa27 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:49.242143 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-30d241d8-16dd-400a-8616-27d3a3dfd50c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:49.243052 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-30d241d8-16dd-400a-8616-27d3a3dfd50c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:49.243704 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-30d241d8-16dd-400a-8616-27d3a3dfd50c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:49.424079 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-30d241d8-16dd-400a-8616-27d3a3dfd50c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.239655 Nov 24 16:06:49.425490 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 142/277] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:49 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:49.432059 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7c141548-1aae-4f62-9868-b8c0940b7f3f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:49.433143 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7c141548-1aae-4f62-9868-b8c0940b7f3f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:49.442836 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7c141548-1aae-4f62-9868-b8c0940b7f3f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:49.443307 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7c141548-1aae-4f62-9868-b8c0940b7f3f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:49.444063 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ca5bc1b6-0041-49fc-9e63-0002b65bfa27 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:49.444235 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7c141548-1aae-4f62-9868-b8c0940b7f3f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:49.444615 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7c141548-1aae-4f62-9868-b8c0940b7f3f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:49.459839 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ca5bc1b6-0041-49fc-9e63-0002b65bfa27 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1317 microversion: 2.1 time: 0.269382 Nov 24 16:06:49.460434 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 136/278] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:49 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:49.562083 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7c141548-1aae-4f62-9868-b8c0940b7f3f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 27630 microversion: 2.1 time: 0.134006 Nov 24 16:06:49.574964 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 143/279] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:49 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 27630 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:49.660709 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-69461eee-c26d-47c2-9e53-dbad1949213f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:49.661344 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-69461eee-c26d-47c2-9e53-dbad1949213f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:49.671130 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69461eee-c26d-47c2-9e53-dbad1949213f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:49.671130 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69461eee-c26d-47c2-9e53-dbad1949213f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:49.671130 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69461eee-c26d-47c2-9e53-dbad1949213f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:49.671394 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69461eee-c26d-47c2-9e53-dbad1949213f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:49.989802 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-69461eee-c26d-47c2-9e53-dbad1949213f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:49.999971 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-69461eee-c26d-47c2-9e53-dbad1949213f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.342775 Nov 24 16:06:50.000861 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 137/280] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:49 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:50.439031 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e4c883f0-7577-4f00-a57b-dfb290d0896a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:50.440925 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e4c883f0-7577-4f00-a57b-dfb290d0896a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:50.451973 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e4c883f0-7577-4f00-a57b-dfb290d0896a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:50.452692 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e4c883f0-7577-4f00-a57b-dfb290d0896a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:50.453898 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e4c883f0-7577-4f00-a57b-dfb290d0896a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:50.454699 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e4c883f0-7577-4f00-a57b-dfb290d0896a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:50.477449 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-03292599-205a-41fd-ab58-c59b363528e6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:50.479247 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-03292599-205a-41fd-ab58-c59b363528e6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:50.486126 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03292599-205a-41fd-ab58-c59b363528e6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:50.486930 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03292599-205a-41fd-ab58-c59b363528e6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:50.487952 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03292599-205a-41fd-ab58-c59b363528e6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:50.488586 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-03292599-205a-41fd-ab58-c59b363528e6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:50.556321 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e4c883f0-7577-4f00-a57b-dfb290d0896a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.120955 Nov 24 16:06:50.567362 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 144/281] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:50 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:06:50.580405 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9706235e-d163-4f75-9e51-a42f5ab9588e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:50.586141 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9706235e-d163-4f75-9e51-a42f5ab9588e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:50.601368 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9706235e-d163-4f75-9e51-a42f5ab9588e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:50.602117 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9706235e-d163-4f75-9e51-a42f5ab9588e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:50.603128 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9706235e-d163-4f75-9e51-a42f5ab9588e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:50.603761 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9706235e-d163-4f75-9e51-a42f5ab9588e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:50.686069 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-03292599-205a-41fd-ab58-c59b363528e6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:50.694944 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-03292599-205a-41fd-ab58-c59b363528e6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1317 microversion: 2.1 time: 0.221267 Nov 24 16:06:50.695601 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 138/282] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:50 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:50.723503 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9706235e-d163-4f75-9e51-a42f5ab9588e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 27884 microversion: 2.1 time: 0.151768 Nov 24 16:06:50.725149 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 145/283] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:50 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 27884 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:51.017639 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3763c1a0-d0b7-4d9d-8ee2-3e928e096e92 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:51.020603 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3763c1a0-d0b7-4d9d-8ee2-3e928e096e92 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:51.028060 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3763c1a0-d0b7-4d9d-8ee2-3e928e096e92 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:51.029005 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3763c1a0-d0b7-4d9d-8ee2-3e928e096e92 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:51.030592 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3763c1a0-d0b7-4d9d-8ee2-3e928e096e92 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:51.031700 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3763c1a0-d0b7-4d9d-8ee2-3e928e096e92 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:51.093548 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-78677846-c85f-4c8c-b4e9-968b4d19b850 req-49101057-9ed7-4aa1-8547-07aab07383ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dbe3561-9e63-4d04-9c0f-563b85fa743f", "name": "network-vif-plugged", "status": "completed", "tag": "3fa4f539-3c48-40d2-a56f-0717a9dc7259"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:51.098318 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:06:51.098318 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:06:51.127827 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-78677846-c85f-4c8c-b4e9-968b4d19b850 req-49101057-9ed7-4aa1-8547-07aab07383ca service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:51.128287 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-78677846-c85f-4c8c-b4e9-968b4d19b850 req-49101057-9ed7-4aa1-8547-07aab07383ca service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:51.163264 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-78677846-c85f-4c8c-b4e9-968b4d19b850 req-49101057-9ed7-4aa1-8547-07aab07383ca service nova] Creating event network-vif-plugged:3fa4f539-3c48-40d2-a56f-0717a9dc7259 for instance 5dbe3561-9e63-4d04-9c0f-563b85fa743f on hv-cinder-81899 Nov 24 16:06:51.169841 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-78677846-c85f-4c8c-b4e9-968b4d19b850 req-49101057-9ed7-4aa1-8547-07aab07383ca service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086767 Nov 24 16:06:51.171999 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 146/284] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:06:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:06:51.278792 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3763c1a0-d0b7-4d9d-8ee2-3e928e096e92 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:51.303057 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3763c1a0-d0b7-4d9d-8ee2-3e928e096e92 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1522 microversion: 2.1 time: 0.288323 Nov 24 16:06:51.305766 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 139/285] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:51 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:51.580574 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ce858c10-eaf5-4e7e-8226-4dc0d62e41c6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:51.583515 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ce858c10-eaf5-4e7e-8226-4dc0d62e41c6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:51.597671 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ce858c10-eaf5-4e7e-8226-4dc0d62e41c6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:51.599014 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ce858c10-eaf5-4e7e-8226-4dc0d62e41c6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:51.600796 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ce858c10-eaf5-4e7e-8226-4dc0d62e41c6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:51.601454 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ce858c10-eaf5-4e7e-8226-4dc0d62e41c6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:51.712603 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4b3a7aec-8937-4bd6-9ec1-5e57c0f1aeec tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:51.713728 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4b3a7aec-8937-4bd6-9ec1-5e57c0f1aeec tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:51.720641 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4b3a7aec-8937-4bd6-9ec1-5e57c0f1aeec tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:51.721258 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4b3a7aec-8937-4bd6-9ec1-5e57c0f1aeec tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:51.722119 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4b3a7aec-8937-4bd6-9ec1-5e57c0f1aeec tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:51.722622 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4b3a7aec-8937-4bd6-9ec1-5e57c0f1aeec tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:51.830804 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ce858c10-eaf5-4e7e-8226-4dc0d62e41c6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.258404 Nov 24 16:06:51.832469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 147/286] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:51 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:51.837186 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-114a121a-0daa-47b8-86e9-b69e90e7cd34 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:51.840237 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-114a121a-0daa-47b8-86e9-b69e90e7cd34 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:51.861872 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-114a121a-0daa-47b8-86e9-b69e90e7cd34 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:51.862410 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-114a121a-0daa-47b8-86e9-b69e90e7cd34 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:51.863471 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-114a121a-0daa-47b8-86e9-b69e90e7cd34 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:51.863963 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-114a121a-0daa-47b8-86e9-b69e90e7cd34 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:51.911818 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4b3a7aec-8937-4bd6-9ec1-5e57c0f1aeec tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:51.924058 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4b3a7aec-8937-4bd6-9ec1-5e57c0f1aeec tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1317 microversion: 2.1 time: 0.214851 Nov 24 16:06:51.925167 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 140/287] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:51 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:51.973432 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-114a121a-0daa-47b8-86e9-b69e90e7cd34 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28059 microversion: 2.1 time: 0.140371 Nov 24 16:06:51.974186 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 148/288] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:51 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28059 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:52.322228 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8fe90c01-d4d3-4895-bb6d-bd42d4bc17ef tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:52.323373 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8fe90c01-d4d3-4895-bb6d-bd42d4bc17ef tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:52.330405 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8fe90c01-d4d3-4895-bb6d-bd42d4bc17ef tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:52.330850 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8fe90c01-d4d3-4895-bb6d-bd42d4bc17ef tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:52.331871 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8fe90c01-d4d3-4895-bb6d-bd42d4bc17ef tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:52.332309 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8fe90c01-d4d3-4895-bb6d-bd42d4bc17ef tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:52.506056 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8fe90c01-d4d3-4895-bb6d-bd42d4bc17ef tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:52.519270 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8fe90c01-d4d3-4895-bb6d-bd42d4bc17ef tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1502 microversion: 2.1 time: 0.200161 Nov 24 16:06:52.525385 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 141/289] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:52 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1502 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:52.548183 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-aa6abf33-c1bb-459f-bb27-ddc47f9259b5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:52.548874 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-aa6abf33-c1bb-459f-bb27-ddc47f9259b5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:52.556568 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aa6abf33-c1bb-459f-bb27-ddc47f9259b5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:52.557011 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aa6abf33-c1bb-459f-bb27-ddc47f9259b5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:52.558895 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aa6abf33-c1bb-459f-bb27-ddc47f9259b5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:52.559333 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aa6abf33-c1bb-459f-bb27-ddc47f9259b5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:52.722677 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-aa6abf33-c1bb-459f-bb27-ddc47f9259b5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:52.731928 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-aa6abf33-c1bb-459f-bb27-ddc47f9259b5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1515 microversion: 2.1 time: 0.187777 Nov 24 16:06:52.732804 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 149/290] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:52 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:52.854743 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4845acf0-3a6e-463f-b3c9-8c09e2c2e443 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:52.856129 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4845acf0-3a6e-463f-b3c9-8c09e2c2e443 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:52.863563 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4845acf0-3a6e-463f-b3c9-8c09e2c2e443 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:52.863865 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4845acf0-3a6e-463f-b3c9-8c09e2c2e443 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:52.864689 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4845acf0-3a6e-463f-b3c9-8c09e2c2e443 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:52.865127 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4845acf0-3a6e-463f-b3c9-8c09e2c2e443 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:52.942490 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d70d06d6-a397-42c1-8ec2-9127dd90b266 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:52.943211 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d70d06d6-a397-42c1-8ec2-9127dd90b266 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:52.952360 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d70d06d6-a397-42c1-8ec2-9127dd90b266 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:52.952815 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d70d06d6-a397-42c1-8ec2-9127dd90b266 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:52.953680 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d70d06d6-a397-42c1-8ec2-9127dd90b266 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:52.954113 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d70d06d6-a397-42c1-8ec2-9127dd90b266 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:52.986381 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4845acf0-3a6e-463f-b3c9-8c09e2c2e443 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.145356 Nov 24 16:06:52.987090 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 142/291] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:52 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:52.993785 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-00d180aa-0fbf-4b65-b73c-452a8827bd5a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:52.996428 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-00d180aa-0fbf-4b65-b73c-452a8827bd5a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:53.004402 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00d180aa-0fbf-4b65-b73c-452a8827bd5a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:53.005169 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00d180aa-0fbf-4b65-b73c-452a8827bd5a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:53.006223 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00d180aa-0fbf-4b65-b73c-452a8827bd5a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:53.006665 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00d180aa-0fbf-4b65-b73c-452a8827bd5a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:53.136652 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-00d180aa-0fbf-4b65-b73c-452a8827bd5a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.147224 Nov 24 16:06:53.151746 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 143/292] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:52 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:06:53.172546 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d70d06d6-a397-42c1-8ec2-9127dd90b266 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:53.184005 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d70d06d6-a397-42c1-8ec2-9127dd90b266 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1317 microversion: 2.1 time: 0.245202 Nov 24 16:06:53.184860 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 150/293] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:52 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:06:54.003479 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c5b7434f-f392-4bdf-94d4-6ac2a6e355c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:54.004491 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c5b7434f-f392-4bdf-94d4-6ac2a6e355c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:54.012234 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5b7434f-f392-4bdf-94d4-6ac2a6e355c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:54.012682 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5b7434f-f392-4bdf-94d4-6ac2a6e355c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:54.013515 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5b7434f-f392-4bdf-94d4-6ac2a6e355c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:54.013948 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5b7434f-f392-4bdf-94d4-6ac2a6e355c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:54.148250 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fe6c282d-206e-4315-aed4-18ccf1a4d4e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:54.149309 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fe6c282d-206e-4315-aed4-18ccf1a4d4e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:54.157660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fe6c282d-206e-4315-aed4-18ccf1a4d4e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:54.158195 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fe6c282d-206e-4315-aed4-18ccf1a4d4e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:54.159117 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fe6c282d-206e-4315-aed4-18ccf1a4d4e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:54.159630 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fe6c282d-206e-4315-aed4-18ccf1a4d4e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:59.336111 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c5b7434f-f392-4bdf-94d4-6ac2a6e355c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 5.336691 Nov 24 16:06:59.336885 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 144/294] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:06:53 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 5339 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:59.343142 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-66e2e90e-e668-4266-be93-14dba0bfcd78 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:59.343838 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-66e2e90e-e668-4266-be93-14dba0bfcd78 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:59.345670 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fe6c282d-206e-4315-aed4-18ccf1a4d4e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 5.201270 Nov 24 16:06:59.346577 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 151/295] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:06:54 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 5203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:06:59.351243 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66e2e90e-e668-4266-be93-14dba0bfcd78 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:59.351740 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66e2e90e-e668-4266-be93-14dba0bfcd78 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:59.352597 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66e2e90e-e668-4266-be93-14dba0bfcd78 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:59.353051 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66e2e90e-e668-4266-be93-14dba0bfcd78 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:59.504144 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-66e2e90e-e668-4266-be93-14dba0bfcd78 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:06:59.512566 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-66e2e90e-e668-4266-be93-14dba0bfcd78 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1508 microversion: 2.1 time: 0.173983 Nov 24 16:06:59.513168 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 145/296] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:06:59 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:06:59.529756 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-77ec4146-c144-4657-a98b-4bf9d6a6fd0b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4852b165-a78a-4442-8767-dff090e94f94"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:06:59.530924 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-77ec4146-c144-4657-a98b-4bf9d6a6fd0b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:59.538443 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-77ec4146-c144-4657-a98b-4bf9d6a6fd0b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:59.539085 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-77ec4146-c144-4657-a98b-4bf9d6a6fd0b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:59.539985 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-77ec4146-c144-4657-a98b-4bf9d6a6fd0b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:59.540433 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-77ec4146-c144-4657-a98b-4bf9d6a6fd0b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:59.626396 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-77ec4146-c144-4657-a98b-4bf9d6a6fd0b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] HTTP exception thrown: Invalid volume: volume 4852b165-a78a-4442-8767-dff090e94f94 is already attached to instances: c7e069fb-95d8-4964-b82d-ca884fcb2b5e Nov 24 16:06:59.627293 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-77ec4146-c144-4657-a98b-4bf9d6a6fd0b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Returning 400 to user: Invalid volume: volume 4852b165-a78a-4442-8767-dff090e94f94 is already attached to instances: c7e069fb-95d8-4964-b82d-ca884fcb2b5e {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:06:59.628118 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-77ec4146-c144-4657-a98b-4bf9d6a6fd0b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "POST /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103042 Nov 24 16:06:59.628676 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 152/297] 10.222.0.72 () {60 vars in 1322 bytes} [Wed Nov 24 16:06:59 2021] POST /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 24 16:06:59.688475 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-44183158-f7a2-40ae-8ca2-9ed48ca73d1f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:59.688970 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-44183158-f7a2-40ae-8ca2-9ed48ca73d1f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:59.695632 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44183158-f7a2-40ae-8ca2-9ed48ca73d1f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:59.696084 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44183158-f7a2-40ae-8ca2-9ed48ca73d1f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:59.696879 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44183158-f7a2-40ae-8ca2-9ed48ca73d1f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:59.697341 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44183158-f7a2-40ae-8ca2-9ed48ca73d1f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:59.821919 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-44183158-f7a2-40ae-8ca2-9ed48ca73d1f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lazy-loading 'services' on Instance uuid c7e069fb-95d8-4964-b82d-ca884fcb2b5e {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:06:59.938285 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-44183158-f7a2-40ae-8ca2-9ed48ca73d1f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments/4852b165-a78a-4442-8767-dff090e94f94" status: 202 len: 0 microversion: 2.1 time: 0.253189 Nov 24 16:06:59.939088 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 146/298] 10.222.0.72 () {58 vars in 1415 bytes} [Wed Nov 24 16:06:59 2021] DELETE /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments/4852b165-a78a-4442-8767-dff090e94f94 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:06:59.950768 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7fdc7a94-d115-425f-97ed-6224afb627b6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:06:59.952701 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7fdc7a94-d115-425f-97ed-6224afb627b6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:06:59.964321 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7fdc7a94-d115-425f-97ed-6224afb627b6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:59.965212 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7fdc7a94-d115-425f-97ed-6224afb627b6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:06:59.966140 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7fdc7a94-d115-425f-97ed-6224afb627b6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:06:59.966676 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7fdc7a94-d115-425f-97ed-6224afb627b6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:00.008100 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7fdc7a94-d115-425f-97ed-6224afb627b6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064391 Nov 24 16:07:00.008682 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 153/299] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:06:59 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:07:00.348847 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f0f52c28-c1af-40fc-bc3e-1bf6c0a67957 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:00.349814 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f0f52c28-c1af-40fc-bc3e-1bf6c0a67957 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:00.357609 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0f52c28-c1af-40fc-bc3e-1bf6c0a67957 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:00.358062 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0f52c28-c1af-40fc-bc3e-1bf6c0a67957 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:00.358863 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0f52c28-c1af-40fc-bc3e-1bf6c0a67957 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:00.359245 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3dd738ed-4aca-40e3-8311-e11f61de55cc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:00.359711 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0f52c28-c1af-40fc-bc3e-1bf6c0a67957 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:00.360208 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3dd738ed-4aca-40e3-8311-e11f61de55cc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:00.366778 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3dd738ed-4aca-40e3-8311-e11f61de55cc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:00.367222 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3dd738ed-4aca-40e3-8311-e11f61de55cc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:00.368010 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3dd738ed-4aca-40e3-8311-e11f61de55cc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:00.368440 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3dd738ed-4aca-40e3-8311-e11f61de55cc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:00.489553 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f0f52c28-c1af-40fc-bc3e-1bf6c0a67957 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.145067 Nov 24 16:07:00.491052 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 147/300] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:00 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:00.492895 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3dd738ed-4aca-40e3-8311-e11f61de55cc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.138831 Nov 24 16:07:00.494303 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 154/301] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:00 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:01.022981 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e4be8d74-4283-4364-b79f-152c829de630 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:01.025216 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e4be8d74-4283-4364-b79f-152c829de630 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:01.033859 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e4be8d74-4283-4364-b79f-152c829de630 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:01.034850 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e4be8d74-4283-4364-b79f-152c829de630 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:01.035755 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e4be8d74-4283-4364-b79f-152c829de630 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:01.036233 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e4be8d74-4283-4364-b79f-152c829de630 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:01.068596 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e4be8d74-4283-4364-b79f-152c829de630 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051082 Nov 24 16:07:01.069281 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 148/302] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:07:01 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:07:01.502415 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8dd75d94-adb4-4dfa-8012-168fa918734a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:01.504075 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8dd75d94-adb4-4dfa-8012-168fa918734a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:01.504777 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-43886eac-238b-4236-a21e-ac63e8a0a0c5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:01.506726 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-43886eac-238b-4236-a21e-ac63e8a0a0c5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:01.511771 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8dd75d94-adb4-4dfa-8012-168fa918734a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:01.512212 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8dd75d94-adb4-4dfa-8012-168fa918734a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:01.513001 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8dd75d94-adb4-4dfa-8012-168fa918734a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:01.513456 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8dd75d94-adb4-4dfa-8012-168fa918734a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:01.514390 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-43886eac-238b-4236-a21e-ac63e8a0a0c5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:01.514847 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-43886eac-238b-4236-a21e-ac63e8a0a0c5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:01.515818 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-43886eac-238b-4236-a21e-ac63e8a0a0c5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:01.516265 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-43886eac-238b-4236-a21e-ac63e8a0a0c5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:04.915577 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-43886eac-238b-4236-a21e-ac63e8a0a0c5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 3.415241 Nov 24 16:07:04.916869 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 149/303] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:01 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 3417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:04.920835 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8dd75d94-adb4-4dfa-8012-168fa918734a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 3.422878 Nov 24 16:07:04.924735 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 155/304] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:01 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 3425 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:04.924879 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1ced07ea-760a-4350-8a82-8c18a6fb1b16 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:04.924879 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1ced07ea-760a-4350-8a82-8c18a6fb1b16 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:04.930914 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1ced07ea-760a-4350-8a82-8c18a6fb1b16 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:04.931369 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1ced07ea-760a-4350-8a82-8c18a6fb1b16 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:04.932240 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1ced07ea-760a-4350-8a82-8c18a6fb1b16 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:04.932670 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1ced07ea-760a-4350-8a82-8c18a6fb1b16 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:04.966404 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1ced07ea-760a-4350-8a82-8c18a6fb1b16 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048260 Nov 24 16:07:04.966974 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 150/305] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:07:04 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:07:05.931812 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-da61dcab-6c99-4ca8-9e93-95b584d2e611 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:05.932994 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-da61dcab-6c99-4ca8-9e93-95b584d2e611 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:05.933775 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-02cce7bc-a6da-4144-adb6-be22c3eb049d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:05.935591 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-02cce7bc-a6da-4144-adb6-be22c3eb049d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:05.939546 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-da61dcab-6c99-4ca8-9e93-95b584d2e611 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:05.939997 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-da61dcab-6c99-4ca8-9e93-95b584d2e611 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:05.940790 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-da61dcab-6c99-4ca8-9e93-95b584d2e611 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:05.941257 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-da61dcab-6c99-4ca8-9e93-95b584d2e611 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:05.949280 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-02cce7bc-a6da-4144-adb6-be22c3eb049d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:05.950187 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-02cce7bc-a6da-4144-adb6-be22c3eb049d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:05.951654 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-02cce7bc-a6da-4144-adb6-be22c3eb049d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:05.952476 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-02cce7bc-a6da-4144-adb6-be22c3eb049d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:06.078950 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-02cce7bc-a6da-4144-adb6-be22c3eb049d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.152898 Nov 24 16:07:06.082549 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 156/306] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:05 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:06.090735 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ea26245f-ad6c-4980-a303-557b018deafe tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:06.091863 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ea26245f-ad6c-4980-a303-557b018deafe tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:06.099440 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ea26245f-ad6c-4980-a303-557b018deafe tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:06.100103 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ea26245f-ad6c-4980-a303-557b018deafe tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:06.100916 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ea26245f-ad6c-4980-a303-557b018deafe tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:06.101381 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ea26245f-ad6c-4980-a303-557b018deafe tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:06.148242 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ea26245f-ad6c-4980-a303-557b018deafe tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065009 Nov 24 16:07:06.148847 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 157/307] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:07:06 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:07:06.188000 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-da61dcab-6c99-4ca8-9e93-95b584d2e611 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.259428 Nov 24 16:07:06.189664 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 151/308] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:05 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:07:07.092282 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4f945133-12c1-4e25-bcdc-e4870b957375 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:07.093212 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4f945133-12c1-4e25-bcdc-e4870b957375 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:07.099531 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4f945133-12c1-4e25-bcdc-e4870b957375 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:07.099974 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4f945133-12c1-4e25-bcdc-e4870b957375 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:07.100765 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4f945133-12c1-4e25-bcdc-e4870b957375 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:07.101213 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4f945133-12c1-4e25-bcdc-e4870b957375 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:07.163779 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d1b9752f-cd66-4ed2-83ee-9e50f13f6f3f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:07.164777 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d1b9752f-cd66-4ed2-83ee-9e50f13f6f3f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:07.172411 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1b9752f-cd66-4ed2-83ee-9e50f13f6f3f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:07.172858 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1b9752f-cd66-4ed2-83ee-9e50f13f6f3f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:07.173673 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1b9752f-cd66-4ed2-83ee-9e50f13f6f3f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:07.174105 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1b9752f-cd66-4ed2-83ee-9e50f13f6f3f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:07.190052 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4f945133-12c1-4e25-bcdc-e4870b957375 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.101175 Nov 24 16:07:07.191285 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 158/309] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:07 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:07.205630 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3485306b-89e3-4507-9577-f4652803a324 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:07.207030 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3485306b-89e3-4507-9577-f4652803a324 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:07.208814 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d1b9752f-cd66-4ed2-83ee-9e50f13f6f3f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049057 Nov 24 16:07:07.209901 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 152/310] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:07:07 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:07:07.219913 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3485306b-89e3-4507-9577-f4652803a324 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:07.220625 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3485306b-89e3-4507-9577-f4652803a324 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:07.221876 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3485306b-89e3-4507-9577-f4652803a324 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:07.222566 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3485306b-89e3-4507-9577-f4652803a324 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:07.310521 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3485306b-89e3-4507-9577-f4652803a324 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.112542 Nov 24 16:07:07.311179 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 159/311] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:07 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:07:08.202755 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c1f8a629-73ca-4408-a04f-d0b774ea902a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:08.203672 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c1f8a629-73ca-4408-a04f-d0b774ea902a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:08.209995 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1f8a629-73ca-4408-a04f-d0b774ea902a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:08.210449 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1f8a629-73ca-4408-a04f-d0b774ea902a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:08.211237 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1f8a629-73ca-4408-a04f-d0b774ea902a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:08.211672 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1f8a629-73ca-4408-a04f-d0b774ea902a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:08.220801 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1626a1da-152d-49a5-b330-28de3c15a8bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:08.221853 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1626a1da-152d-49a5-b330-28de3c15a8bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:08.229399 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1626a1da-152d-49a5-b330-28de3c15a8bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:08.229851 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1626a1da-152d-49a5-b330-28de3c15a8bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:08.230647 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1626a1da-152d-49a5-b330-28de3c15a8bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:08.231081 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1626a1da-152d-49a5-b330-28de3c15a8bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:08.263511 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1626a1da-152d-49a5-b330-28de3c15a8bb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046832 Nov 24 16:07:08.264076 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 160/312] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:07:08 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:07:08.284650 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c1f8a629-73ca-4408-a04f-d0b774ea902a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.085380 Nov 24 16:07:08.285327 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 153/313] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:08 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:08.322593 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-16bddfb6-3aa7-4696-a0dd-6cfef43efbb6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:08.323500 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-16bddfb6-3aa7-4696-a0dd-6cfef43efbb6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:08.329781 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-16bddfb6-3aa7-4696-a0dd-6cfef43efbb6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:08.330235 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-16bddfb6-3aa7-4696-a0dd-6cfef43efbb6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:08.331008 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-16bddfb6-3aa7-4696-a0dd-6cfef43efbb6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:08.331443 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-16bddfb6-3aa7-4696-a0dd-6cfef43efbb6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:08.427127 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-16bddfb6-3aa7-4696-a0dd-6cfef43efbb6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.108261 Nov 24 16:07:08.427809 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 161/314] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:08 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:07:09.276213 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-23e2273b-82cc-4934-971f-90a38413765f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:09.277335 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-23e2273b-82cc-4934-971f-90a38413765f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:09.284608 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23e2273b-82cc-4934-971f-90a38413765f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:09.285084 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23e2273b-82cc-4934-971f-90a38413765f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:09.285893 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23e2273b-82cc-4934-971f-90a38413765f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:09.286333 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23e2273b-82cc-4934-971f-90a38413765f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:09.298082 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-58575d5b-74ef-4474-96da-7b2a1b295b0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:09.299288 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-58575d5b-74ef-4474-96da-7b2a1b295b0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:09.306294 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-58575d5b-74ef-4474-96da-7b2a1b295b0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:09.307450 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-58575d5b-74ef-4474-96da-7b2a1b295b0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:09.308278 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-58575d5b-74ef-4474-96da-7b2a1b295b0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:09.308691 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-58575d5b-74ef-4474-96da-7b2a1b295b0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:09.318864 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-23e2273b-82cc-4934-971f-90a38413765f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047055 Nov 24 16:07:09.319645 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 154/315] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:07:09 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:07:09.401545 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-58575d5b-74ef-4474-96da-7b2a1b295b0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.107014 Nov 24 16:07:09.402280 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 162/316] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:09 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:09.439541 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3e4e8482-a91d-448f-be29-ad1575c5cbb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:09.440584 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3e4e8482-a91d-448f-be29-ad1575c5cbb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:09.447895 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3e4e8482-a91d-448f-be29-ad1575c5cbb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:09.448344 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3e4e8482-a91d-448f-be29-ad1575c5cbb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:09.449475 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3e4e8482-a91d-448f-be29-ad1575c5cbb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:09.449777 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3e4e8482-a91d-448f-be29-ad1575c5cbb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:10.015051 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ccca4b14-f42f-42ce-be1c-f66228347655 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:10.016088 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ccca4b14-f42f-42ce-be1c-f66228347655 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:10.023539 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ccca4b14-f42f-42ce-be1c-f66228347655 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:10.023979 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ccca4b14-f42f-42ce-be1c-f66228347655 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:10.024774 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ccca4b14-f42f-42ce-be1c-f66228347655 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:10.025420 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ccca4b14-f42f-42ce-be1c-f66228347655 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:10.051148 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.objects.instance [None req-ccca4b14-f42f-42ce-be1c-f66228347655 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lazy-loading 'flavor' on Instance uuid a3a9b563-1f54-4c61-923f-9b557a3c307b {{(pid=116303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:07:10.170701 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ccca4b14-f42f-42ce-be1c-f66228347655 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "POST /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/action" status: 200 len: 32 microversion: 2.1 time: 0.160601 Nov 24 16:07:10.171231 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 163/317] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:10 2021] POST /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 16:07:10.180450 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4262b8e6-c708-41e3-97dd-a37c14fc203c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:10.181212 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4262b8e6-c708-41e3-97dd-a37c14fc203c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:10.188021 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4262b8e6-c708-41e3-97dd-a37c14fc203c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:10.188472 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4262b8e6-c708-41e3-97dd-a37c14fc203c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:10.189292 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4262b8e6-c708-41e3-97dd-a37c14fc203c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:10.189724 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4262b8e6-c708-41e3-97dd-a37c14fc203c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:10.328108 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4262b8e6-c708-41e3-97dd-a37c14fc203c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:10.335769 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4262b8e6-c708-41e3-97dd-a37c14fc203c tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.159265 Nov 24 16:07:10.336354 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 164/318] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:10 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:07:10.342584 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e1c892b8-ff35-482b-abdc-aa292dcc011d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:10.343503 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e1c892b8-ff35-482b-abdc-aa292dcc011d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:10.350312 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e1c892b8-ff35-482b-abdc-aa292dcc011d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:10.350763 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e1c892b8-ff35-482b-abdc-aa292dcc011d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:10.351606 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e1c892b8-ff35-482b-abdc-aa292dcc011d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:10.352040 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e1c892b8-ff35-482b-abdc-aa292dcc011d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:10.383170 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e1c892b8-ff35-482b-abdc-aa292dcc011d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Nov 24 16:07:10.383751 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 165/319] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:07:10 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:07:10.417726 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c296db3a-8925-4a27-9a73-76c1b2e596ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:10.419373 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c296db3a-8925-4a27-9a73-76c1b2e596ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:10.430125 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c296db3a-8925-4a27-9a73-76c1b2e596ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:10.430884 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c296db3a-8925-4a27-9a73-76c1b2e596ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:10.432886 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c296db3a-8925-4a27-9a73-76c1b2e596ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:10.433736 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c296db3a-8925-4a27-9a73-76c1b2e596ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:15.042331 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3e4e8482-a91d-448f-be29-ad1575c5cbb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 5.606730 Nov 24 16:07:15.047326 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 155/320] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:09 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 5612 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:07:15.048452 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c296db3a-8925-4a27-9a73-76c1b2e596ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 4.637666 Nov 24 16:07:15.049154 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 166/321] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:10 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 4640 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:15.053496 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ffba5637-c0d5-4289-bc4a-b49e63b08750 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:15.054192 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ffba5637-c0d5-4289-bc4a-b49e63b08750 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:15.058776 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-dbecdfb2-f3f2-4257-9812-5989cdfe71fb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:15.062540 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffba5637-c0d5-4289-bc4a-b49e63b08750 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:15.063660 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffba5637-c0d5-4289-bc4a-b49e63b08750 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:15.065168 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffba5637-c0d5-4289-bc4a-b49e63b08750 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:15.066252 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffba5637-c0d5-4289-bc4a-b49e63b08750 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:15.067843 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-dbecdfb2-f3f2-4257-9812-5989cdfe71fb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:15.086702 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dbecdfb2-f3f2-4257-9812-5989cdfe71fb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:15.087146 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dbecdfb2-f3f2-4257-9812-5989cdfe71fb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:15.089097 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dbecdfb2-f3f2-4257-9812-5989cdfe71fb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:15.089717 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dbecdfb2-f3f2-4257-9812-5989cdfe71fb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:15.127964 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-dbecdfb2-f3f2-4257-9812-5989cdfe71fb tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074804 Nov 24 16:07:15.127964 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 167/322] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:07:15 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:07:15.396582 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ffba5637-c0d5-4289-bc4a-b49e63b08750 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:15.404890 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ffba5637-c0d5-4289-bc4a-b49e63b08750 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.356253 Nov 24 16:07:15.418057 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 156/323] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:15 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:16.054092 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4a7c4f28-56d8-46c1-9e21-63cc2068711c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:16.055076 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4a7c4f28-56d8-46c1-9e21-63cc2068711c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:16.059843 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-358fdddc-41bc-4442-adf1-aee292177c6d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:16.061678 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-358fdddc-41bc-4442-adf1-aee292177c6d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:16.066297 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4a7c4f28-56d8-46c1-9e21-63cc2068711c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:16.069579 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-358fdddc-41bc-4442-adf1-aee292177c6d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:16.070023 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4a7c4f28-56d8-46c1-9e21-63cc2068711c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:16.070147 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-358fdddc-41bc-4442-adf1-aee292177c6d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:16.071058 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-358fdddc-41bc-4442-adf1-aee292177c6d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:16.071577 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-358fdddc-41bc-4442-adf1-aee292177c6d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:16.073332 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4a7c4f28-56d8-46c1-9e21-63cc2068711c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:16.073812 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4a7c4f28-56d8-46c1-9e21-63cc2068711c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:16.176682 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-358fdddc-41bc-4442-adf1-aee292177c6d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.120242 Nov 24 16:07:16.180642 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 157/324] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:16 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:16.185332 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-10af6c4e-9021-4e43-ae2e-708cbfd3eb23 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:16.186377 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-10af6c4e-9021-4e43-ae2e-708cbfd3eb23 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:16.194157 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10af6c4e-9021-4e43-ae2e-708cbfd3eb23 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:16.194619 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10af6c4e-9021-4e43-ae2e-708cbfd3eb23 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:16.195430 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10af6c4e-9021-4e43-ae2e-708cbfd3eb23 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:16.195874 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-10af6c4e-9021-4e43-ae2e-708cbfd3eb23 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:16.200210 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4a7c4f28-56d8-46c1-9e21-63cc2068711c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.149951 Nov 24 16:07:16.214730 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 168/325] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:16 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:07:16.252831 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-10af6c4e-9021-4e43-ae2e-708cbfd3eb23 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071664 Nov 24 16:07:16.256129 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 158/326] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:07:16 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:07:16.426592 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-224f196e-27bd-4bf2-94b6-93b43bb73b82 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:16.427363 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-224f196e-27bd-4bf2-94b6-93b43bb73b82 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:16.434536 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-224f196e-27bd-4bf2-94b6-93b43bb73b82 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:16.434984 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-224f196e-27bd-4bf2-94b6-93b43bb73b82 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:16.435777 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-224f196e-27bd-4bf2-94b6-93b43bb73b82 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:16.436205 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-224f196e-27bd-4bf2-94b6-93b43bb73b82 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:16.471382 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-301579509", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "networks": [{"uuid": "fafb4435-765d-4616-9638-8248f7ef836b"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:16.543165 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] validate_networks() for [('fafb4435-765d-4616-9638-8248f7ef836b', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:07:16.623737 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-224f196e-27bd-4bf2-94b6-93b43bb73b82 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:16.631919 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-224f196e-27bd-4bf2-94b6-93b43bb73b82 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.209669 Nov 24 16:07:16.632492 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 169/327] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:16 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:17.032478 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:07:17.032926 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:07:17.033434 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:07:17.033842 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:07:17.034290 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:07:17.043884 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:17.044331 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:17.045184 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:17.045619 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:17.063357 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Getting quotas for project 20c9176ab8ef44ffb17eda5f41aca2a8. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:07:17.067753 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Getting quotas for user 9fe7f58143cd4ee2bc161e220fbbbd12 and project 20c9176ab8ef44ffb17eda5f41aca2a8. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:07:17.079577 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:07:17.081956 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:07:17.132280 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-13259f80-3f1c-4989-811e-a833f895cfb3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664461 Nov 24 16:07:17.132833 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 159/328] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:07:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 16:07:17.145866 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3d201a9b-956a-44c8-b0af-f8944c2cd61c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:17.147975 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3d201a9b-956a-44c8-b0af-f8944c2cd61c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:17.191298 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a9c83013-6cd6-4bbc-8f66-5d9d272bb130 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:17.192435 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a9c83013-6cd6-4bbc-8f66-5d9d272bb130 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:17.200192 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a9c83013-6cd6-4bbc-8f66-5d9d272bb130 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:17.200914 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a9c83013-6cd6-4bbc-8f66-5d9d272bb130 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:17.202279 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a9c83013-6cd6-4bbc-8f66-5d9d272bb130 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:17.203521 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a9c83013-6cd6-4bbc-8f66-5d9d272bb130 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:17.210815 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3d201a9b-956a-44c8-b0af-f8944c2cd61c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:17.220855 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3d201a9b-956a-44c8-b0af-f8944c2cd61c tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1217 microversion: 2.1 time: 0.080174 Nov 24 16:07:17.220855 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 170/329] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:17 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:17.261121 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e876c558-866d-4725-b1c6-3d3fbb15a521 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:17.262098 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e876c558-866d-4725-b1c6-3d3fbb15a521 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:17.268194 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e876c558-866d-4725-b1c6-3d3fbb15a521 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:17.268638 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e876c558-866d-4725-b1c6-3d3fbb15a521 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:17.269551 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e876c558-866d-4725-b1c6-3d3fbb15a521 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:17.269994 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e876c558-866d-4725-b1c6-3d3fbb15a521 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:17.291644 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a9c83013-6cd6-4bbc-8f66-5d9d272bb130 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.103721 Nov 24 16:07:17.292325 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 160/330] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:17 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:17.372863 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e876c558-866d-4725-b1c6-3d3fbb15a521 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.116273 Nov 24 16:07:17.373676 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 171/331] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:17 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:17.655103 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-91d5cc3d-0070-4802-baba-71fbb77324f9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:17.656296 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-91d5cc3d-0070-4802-baba-71fbb77324f9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:17.672761 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91d5cc3d-0070-4802-baba-71fbb77324f9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:17.674061 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91d5cc3d-0070-4802-baba-71fbb77324f9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:17.675700 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91d5cc3d-0070-4802-baba-71fbb77324f9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:17.676356 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91d5cc3d-0070-4802-baba-71fbb77324f9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:17.865694 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-91d5cc3d-0070-4802-baba-71fbb77324f9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:17.875255 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-91d5cc3d-0070-4802-baba-71fbb77324f9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.227859 Nov 24 16:07:17.875851 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 161/332] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:17 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:18.243341 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-aab3961c-b376-403e-b54b-a73e95a2d6b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:18.244728 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-aab3961c-b376-403e-b54b-a73e95a2d6b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:18.252794 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aab3961c-b376-403e-b54b-a73e95a2d6b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:18.252997 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aab3961c-b376-403e-b54b-a73e95a2d6b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:18.253818 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aab3961c-b376-403e-b54b-a73e95a2d6b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:18.254258 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aab3961c-b376-403e-b54b-a73e95a2d6b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:18.307747 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-90ddd6c8-f494-4e5d-bf67-6b7ec8bce913 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:18.308683 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-90ddd6c8-f494-4e5d-bf67-6b7ec8bce913 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:18.316071 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90ddd6c8-f494-4e5d-bf67-6b7ec8bce913 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:18.316570 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90ddd6c8-f494-4e5d-bf67-6b7ec8bce913 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:18.318148 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90ddd6c8-f494-4e5d-bf67-6b7ec8bce913 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:18.318148 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90ddd6c8-f494-4e5d-bf67-6b7ec8bce913 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:18.321279 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-aab3961c-b376-403e-b54b-a73e95a2d6b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:18.331048 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-aab3961c-b376-403e-b54b-a73e95a2d6b9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1213 microversion: 2.1 time: 0.091725 Nov 24 16:07:18.331627 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 172/333] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:18 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:18.386587 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4eef922e-e093-49ce-8ed2-55ec7d5eb636 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:18.387502 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4eef922e-e093-49ce-8ed2-55ec7d5eb636 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:18.393501 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4eef922e-e093-49ce-8ed2-55ec7d5eb636 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:18.393943 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4eef922e-e093-49ce-8ed2-55ec7d5eb636 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:18.394721 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4eef922e-e093-49ce-8ed2-55ec7d5eb636 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:18.395143 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4eef922e-e093-49ce-8ed2-55ec7d5eb636 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:22.505761 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4eef922e-e093-49ce-8ed2-55ec7d5eb636 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 4.124082 Nov 24 16:07:22.506793 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 173/334] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:18 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 4126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:07:22.512898 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6019d33b-7fee-4c61-84aa-c6ad4e311133 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:22.513646 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6019d33b-7fee-4c61-84aa-c6ad4e311133 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:22.522524 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6019d33b-7fee-4c61-84aa-c6ad4e311133 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:22.522949 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6019d33b-7fee-4c61-84aa-c6ad4e311133 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:22.523791 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6019d33b-7fee-4c61-84aa-c6ad4e311133 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:22.524238 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6019d33b-7fee-4c61-84aa-c6ad4e311133 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:22.555392 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-90ddd6c8-f494-4e5d-bf67-6b7ec8bce913 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 4.250757 Nov 24 16:07:22.558158 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 162/335] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:18 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 4255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:22.568578 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-629c4b2f-569c-4e83-b1d5-f482b59a2fa2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:22.569869 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-629c4b2f-569c-4e83-b1d5-f482b59a2fa2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:22.586831 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-629c4b2f-569c-4e83-b1d5-f482b59a2fa2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:22.587966 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-629c4b2f-569c-4e83-b1d5-f482b59a2fa2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:22.589760 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-629c4b2f-569c-4e83-b1d5-f482b59a2fa2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:22.590439 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-629c4b2f-569c-4e83-b1d5-f482b59a2fa2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:22.690494 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-629c4b2f-569c-4e83-b1d5-f482b59a2fa2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:22.698654 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-629c4b2f-569c-4e83-b1d5-f482b59a2fa2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1269 microversion: 2.1 time: 0.138288 Nov 24 16:07:22.699619 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 163/336] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:22 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1269 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:22.713153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6019d33b-7fee-4c61-84aa-c6ad4e311133 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:22.720979 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6019d33b-7fee-4c61-84aa-c6ad4e311133 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.213318 Nov 24 16:07:22.721506 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 174/337] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:22 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:23.521553 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e56386e7-7e18-4256-ae2b-08431f64c6aa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:23.523188 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e56386e7-7e18-4256-ae2b-08431f64c6aa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:23.529991 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e56386e7-7e18-4256-ae2b-08431f64c6aa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:23.530723 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e56386e7-7e18-4256-ae2b-08431f64c6aa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:23.531535 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e56386e7-7e18-4256-ae2b-08431f64c6aa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:23.531970 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e56386e7-7e18-4256-ae2b-08431f64c6aa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:23.571947 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b93fdd80-4175-4f5c-a7ab-85f82658ebf0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:23.573356 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b93fdd80-4175-4f5c-a7ab-85f82658ebf0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:23.579806 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b93fdd80-4175-4f5c-a7ab-85f82658ebf0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:23.580256 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b93fdd80-4175-4f5c-a7ab-85f82658ebf0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:23.581062 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b93fdd80-4175-4f5c-a7ab-85f82658ebf0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:23.581531 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b93fdd80-4175-4f5c-a7ab-85f82658ebf0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:23.602716 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e56386e7-7e18-4256-ae2b-08431f64c6aa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.085284 Nov 24 16:07:23.604935 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 164/338] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:23 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:23.702086 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b93fdd80-4175-4f5c-a7ab-85f82658ebf0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.125781 Nov 24 16:07:23.704305 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 175/339] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:23 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:23.717711 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e734253d-44cf-433c-aee8-054c662ca364 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:23.718423 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e734253d-44cf-433c-aee8-054c662ca364 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:23.732832 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e734253d-44cf-433c-aee8-054c662ca364 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:23.732832 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e734253d-44cf-433c-aee8-054c662ca364 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:23.738455 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-cfc52d3f-6abf-47df-8e80-dfd6b4030d0b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:23.739943 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-cfc52d3f-6abf-47df-8e80-dfd6b4030d0b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:23.741948 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e734253d-44cf-433c-aee8-054c662ca364 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:23.742504 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e734253d-44cf-433c-aee8-054c662ca364 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:23.753576 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cfc52d3f-6abf-47df-8e80-dfd6b4030d0b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:23.754027 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cfc52d3f-6abf-47df-8e80-dfd6b4030d0b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:23.754846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cfc52d3f-6abf-47df-8e80-dfd6b4030d0b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:23.759050 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cfc52d3f-6abf-47df-8e80-dfd6b4030d0b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:23.950899 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-cfc52d3f-6abf-47df-8e80-dfd6b4030d0b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:23.959394 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-cfc52d3f-6abf-47df-8e80-dfd6b4030d0b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.225002 Nov 24 16:07:23.959974 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 176/340] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:23 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:07:24.060010 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e734253d-44cf-433c-aee8-054c662ca364 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:24.068913 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e734253d-44cf-433c-aee8-054c662ca364 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1317 microversion: 2.1 time: 0.355028 Nov 24 16:07:24.069876 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 165/341] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:23 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:24.585539 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-a1abae97-a2f1-4c55-93b2-b907ef69ce58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d0795a5-a12b-487a-8717-c9e4c33bd48c", "tag": "f6b62b55-c282-46ef-a9ba-700f74a8fa81"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:24.596462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:07:24.596462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:07:24.623791 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a4f88014-6f0c-44ee-8dd0-22c3abbdab33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:24.640338 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a4f88014-6f0c-44ee-8dd0-22c3abbdab33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:24.641454 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-a1abae97-a2f1-4c55-93b2-b907ef69ce58 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:24.644673 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-a1abae97-a2f1-4c55-93b2-b907ef69ce58 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:24.671077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4f88014-6f0c-44ee-8dd0-22c3abbdab33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:24.673066 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4f88014-6f0c-44ee-8dd0-22c3abbdab33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:24.682214 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4f88014-6f0c-44ee-8dd0-22c3abbdab33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:24.683068 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a4f88014-6f0c-44ee-8dd0-22c3abbdab33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:24.692961 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-a1abae97-a2f1-4c55-93b2-b907ef69ce58 service nova] Creating event network-changed:f6b62b55-c282-46ef-a9ba-700f74a8fa81 for instance 5d0795a5-a12b-487a-8717-c9e4c33bd48c on hv-cinder-81899 Nov 24 16:07:24.706862 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-4cb13540-d66d-40c0-b497-ebb6f1bc8bcc req-a1abae97-a2f1-4c55-93b2-b907ef69ce58 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131637 Nov 24 16:07:24.710174 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 177/342] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:07:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:07:24.723218 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b5c2fa25-1638-45e5-ab5f-fa5419ed0e28 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:24.724391 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b5c2fa25-1638-45e5-ab5f-fa5419ed0e28 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:24.739937 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b5c2fa25-1638-45e5-ab5f-fa5419ed0e28 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:24.740728 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b5c2fa25-1638-45e5-ab5f-fa5419ed0e28 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:24.741586 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b5c2fa25-1638-45e5-ab5f-fa5419ed0e28 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:24.742183 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b5c2fa25-1638-45e5-ab5f-fa5419ed0e28 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:24.867537 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a4f88014-6f0c-44ee-8dd0-22c3abbdab33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.253936 Nov 24 16:07:24.871226 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 166/343] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:24 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:24.875325 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b5c2fa25-1638-45e5-ab5f-fa5419ed0e28 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.161079 Nov 24 16:07:24.875982 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 178/344] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:24 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:24.984183 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cb7ffcb7-9c7d-4fda-9dff-e583d5025554 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:24.984864 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cb7ffcb7-9c7d-4fda-9dff-e583d5025554 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:25.005186 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cb7ffcb7-9c7d-4fda-9dff-e583d5025554 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:25.005944 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cb7ffcb7-9c7d-4fda-9dff-e583d5025554 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:25.006626 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cb7ffcb7-9c7d-4fda-9dff-e583d5025554 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:25.007035 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cb7ffcb7-9c7d-4fda-9dff-e583d5025554 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:25.091864 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d0dcb2f8-3dbd-4dda-b998-96019c2d0944 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:25.093109 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d0dcb2f8-3dbd-4dda-b998-96019c2d0944 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:25.106669 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d0dcb2f8-3dbd-4dda-b998-96019c2d0944 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:25.107399 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d0dcb2f8-3dbd-4dda-b998-96019c2d0944 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:25.108795 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d0dcb2f8-3dbd-4dda-b998-96019c2d0944 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:25.109581 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d0dcb2f8-3dbd-4dda-b998-96019c2d0944 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:25.265272 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cb7ffcb7-9c7d-4fda-9dff-e583d5025554 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:25.277296 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cb7ffcb7-9c7d-4fda-9dff-e583d5025554 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.297320 Nov 24 16:07:25.278841 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 167/345] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:24 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:07:25.336281 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d0dcb2f8-3dbd-4dda-b998-96019c2d0944 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:25.346853 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d0dcb2f8-3dbd-4dda-b998-96019c2d0944 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1317 microversion: 2.1 time: 0.262726 Nov 24 16:07:25.347945 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 179/346] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:25 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:07:25.880609 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7fa2f3d9-02d3-4177-8b6b-db437e822635 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:25.882802 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7fa2f3d9-02d3-4177-8b6b-db437e822635 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:25.888401 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-566b8a51-b2eb-4342-a415-a249683328ef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:25.890173 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-566b8a51-b2eb-4342-a415-a249683328ef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:25.892222 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7fa2f3d9-02d3-4177-8b6b-db437e822635 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:25.893064 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7fa2f3d9-02d3-4177-8b6b-db437e822635 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:25.894445 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7fa2f3d9-02d3-4177-8b6b-db437e822635 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:25.895190 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7fa2f3d9-02d3-4177-8b6b-db437e822635 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:25.901675 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-566b8a51-b2eb-4342-a415-a249683328ef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:25.902117 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-566b8a51-b2eb-4342-a415-a249683328ef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:25.903813 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-566b8a51-b2eb-4342-a415-a249683328ef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:25.905598 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-566b8a51-b2eb-4342-a415-a249683328ef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:32.638958 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-566b8a51-b2eb-4342-a415-a249683328ef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 6.755026 Nov 24 16:07:32.639936 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 180/347] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:25 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 6757 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:32.644515 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7fa2f3d9-02d3-4177-8b6b-db437e822635 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 6.767722 Nov 24 16:07:32.645173 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7c867eab-9b4c-4873-9761-2efea86afccc tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:32.645291 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 168/348] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:25 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 6769 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:32.645476 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7c867eab-9b4c-4873-9761-2efea86afccc tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:32.651531 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b43f0508-275b-4480-b674-973fcc7f75ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:32.652262 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b43f0508-275b-4480-b674-973fcc7f75ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:32.654364 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7c867eab-9b4c-4873-9761-2efea86afccc tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:32.654817 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7c867eab-9b4c-4873-9761-2efea86afccc tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:32.655620 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7c867eab-9b4c-4873-9761-2efea86afccc tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:32.656056 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7c867eab-9b4c-4873-9761-2efea86afccc tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:32.660559 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b43f0508-275b-4480-b674-973fcc7f75ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:32.661506 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b43f0508-275b-4480-b674-973fcc7f75ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:32.662345 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b43f0508-275b-4480-b674-973fcc7f75ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:32.662787 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b43f0508-275b-4480-b674-973fcc7f75ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:32.817217 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7c867eab-9b4c-4873-9761-2efea86afccc tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:32.826297 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7c867eab-9b4c-4873-9761-2efea86afccc tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.185468 Nov 24 16:07:32.826909 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 181/349] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:32 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:32.835889 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b43f0508-275b-4480-b674-973fcc7f75ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:32.844508 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b43f0508-275b-4480-b674-973fcc7f75ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1317 microversion: 2.1 time: 0.198115 Nov 24 16:07:32.845377 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 169/350] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:32 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:33.650037 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5c19983d-8a4e-48b5-9aac-e2198e955af2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:33.650860 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5c19983d-8a4e-48b5-9aac-e2198e955af2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:33.660923 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-08c6e76e-e4f9-4085-99da-392acf0e7e44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:33.661585 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5c19983d-8a4e-48b5-9aac-e2198e955af2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:33.662179 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5c19983d-8a4e-48b5-9aac-e2198e955af2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:33.662295 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-08c6e76e-e4f9-4085-99da-392acf0e7e44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:33.663635 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5c19983d-8a4e-48b5-9aac-e2198e955af2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:33.664451 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5c19983d-8a4e-48b5-9aac-e2198e955af2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:33.672292 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-08c6e76e-e4f9-4085-99da-392acf0e7e44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:33.672955 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-08c6e76e-e4f9-4085-99da-392acf0e7e44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:33.674278 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-08c6e76e-e4f9-4085-99da-392acf0e7e44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:33.675512 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-08c6e76e-e4f9-4085-99da-392acf0e7e44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:33.758936 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5c19983d-8a4e-48b5-9aac-e2198e955af2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.112503 Nov 24 16:07:33.759615 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 182/351] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:33 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:33.768158 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-08c6e76e-e4f9-4085-99da-392acf0e7e44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.112894 Nov 24 16:07:33.772265 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 170/352] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:33 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:07:33.844986 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8e8b7b52-f2fd-460c-9c6e-a664150193e0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:33.845722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8e8b7b52-f2fd-460c-9c6e-a664150193e0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:33.853950 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8e8b7b52-f2fd-460c-9c6e-a664150193e0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:33.854407 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8e8b7b52-f2fd-460c-9c6e-a664150193e0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:33.855217 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8e8b7b52-f2fd-460c-9c6e-a664150193e0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:33.855655 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8e8b7b52-f2fd-460c-9c6e-a664150193e0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:33.868299 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dc9767a8-a1c3-476a-baf7-7a55983cfe75 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:33.869352 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dc9767a8-a1c3-476a-baf7-7a55983cfe75 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:33.876528 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc9767a8-a1c3-476a-baf7-7a55983cfe75 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:33.876985 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc9767a8-a1c3-476a-baf7-7a55983cfe75 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:33.877813 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc9767a8-a1c3-476a-baf7-7a55983cfe75 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:33.878244 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dc9767a8-a1c3-476a-baf7-7a55983cfe75 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:34.007135 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8e8b7b52-f2fd-460c-9c6e-a664150193e0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:34.015830 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8e8b7b52-f2fd-460c-9c6e-a664150193e0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.174842 Nov 24 16:07:34.016416 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 183/353] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:33 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:34.066814 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dc9767a8-a1c3-476a-baf7-7a55983cfe75 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:34.075216 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dc9767a8-a1c3-476a-baf7-7a55983cfe75 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1317 microversion: 2.1 time: 0.211549 Nov 24 16:07:34.075801 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 171/354] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:33 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:34.771189 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-51606e82-94d6-49cb-add3-4a8fdbe2be12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:34.772011 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-51606e82-94d6-49cb-add3-4a8fdbe2be12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:34.779503 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-51606e82-94d6-49cb-add3-4a8fdbe2be12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:34.779945 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-51606e82-94d6-49cb-add3-4a8fdbe2be12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:34.780359 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-818f412d-f762-4241-8330-a89592dda06f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:34.780846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-51606e82-94d6-49cb-add3-4a8fdbe2be12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:34.781188 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-51606e82-94d6-49cb-add3-4a8fdbe2be12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:34.781317 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-818f412d-f762-4241-8330-a89592dda06f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:34.788253 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-818f412d-f762-4241-8330-a89592dda06f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:34.788706 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-818f412d-f762-4241-8330-a89592dda06f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:34.789587 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-818f412d-f762-4241-8330-a89592dda06f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:34.790651 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-818f412d-f762-4241-8330-a89592dda06f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:34.868337 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-51606e82-94d6-49cb-add3-4a8fdbe2be12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.100484 Nov 24 16:07:34.870113 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 184/355] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:34 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:34.871751 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-818f412d-f762-4241-8330-a89592dda06f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.094906 Nov 24 16:07:34.872600 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 172/356] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:34 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:07:35.034207 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-78f048dc-81b4-41a7-8b67-d4bcb6be9e1e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:35.034811 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-78f048dc-81b4-41a7-8b67-d4bcb6be9e1e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:35.041923 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-78f048dc-81b4-41a7-8b67-d4bcb6be9e1e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:35.042368 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-78f048dc-81b4-41a7-8b67-d4bcb6be9e1e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:35.043145 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-78f048dc-81b4-41a7-8b67-d4bcb6be9e1e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:35.043761 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-78f048dc-81b4-41a7-8b67-d4bcb6be9e1e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:35.093744 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2bf78802-cd73-4d06-bca5-acd5b9c49440 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:35.094712 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2bf78802-cd73-4d06-bca5-acd5b9c49440 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:35.101389 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2bf78802-cd73-4d06-bca5-acd5b9c49440 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:35.102296 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2bf78802-cd73-4d06-bca5-acd5b9c49440 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:35.103119 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2bf78802-cd73-4d06-bca5-acd5b9c49440 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:35.103550 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2bf78802-cd73-4d06-bca5-acd5b9c49440 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:35.203615 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-78f048dc-81b4-41a7-8b67-d4bcb6be9e1e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:35.211981 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-78f048dc-81b4-41a7-8b67-d4bcb6be9e1e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.181731 Nov 24 16:07:35.213532 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 185/357] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:35 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:35.494578 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2bf78802-cd73-4d06-bca5-acd5b9c49440 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:35.507677 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2bf78802-cd73-4d06-bca5-acd5b9c49440 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1317 microversion: 2.1 time: 0.418413 Nov 24 16:07:35.508843 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 173/358] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:35 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:35.880384 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-bef1e5e4-7993-49b0-b732-3acfdf9062d3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:35.881241 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-bef1e5e4-7993-49b0-b732-3acfdf9062d3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:35.884441 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-570a1f24-eca7-4c6d-bbb2-8f21dc37e09c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:35.885857 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-570a1f24-eca7-4c6d-bbb2-8f21dc37e09c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:35.889082 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bef1e5e4-7993-49b0-b732-3acfdf9062d3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:35.889567 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bef1e5e4-7993-49b0-b732-3acfdf9062d3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:35.890371 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bef1e5e4-7993-49b0-b732-3acfdf9062d3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:35.890807 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bef1e5e4-7993-49b0-b732-3acfdf9062d3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:35.892923 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-570a1f24-eca7-4c6d-bbb2-8f21dc37e09c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:35.894126 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-570a1f24-eca7-4c6d-bbb2-8f21dc37e09c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:35.894126 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-570a1f24-eca7-4c6d-bbb2-8f21dc37e09c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:35.894761 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-570a1f24-eca7-4c6d-bbb2-8f21dc37e09c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:35.970834 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-bef1e5e4-7993-49b0-b732-3acfdf9062d3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.094334 Nov 24 16:07:35.972425 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 186/359] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:35 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:35.994309 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-570a1f24-eca7-4c6d-bbb2-8f21dc37e09c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.114580 Nov 24 16:07:35.995230 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 174/360] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:35 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:07:36.231817 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0380627e-b145-4802-8b4c-db435face13f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:36.232511 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0380627e-b145-4802-8b4c-db435face13f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:36.239412 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0380627e-b145-4802-8b4c-db435face13f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:36.239860 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0380627e-b145-4802-8b4c-db435face13f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:36.240644 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0380627e-b145-4802-8b4c-db435face13f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:36.241113 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0380627e-b145-4802-8b4c-db435face13f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:36.372965 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-0380627e-b145-4802-8b4c-db435face13f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:36.380616 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0380627e-b145-4802-8b4c-db435face13f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.153655 Nov 24 16:07:36.381211 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 187/361] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:36 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:36.530119 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-69809b7d-72e3-4ad9-a943-529b5112f8e7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:36.530831 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-69809b7d-72e3-4ad9-a943-529b5112f8e7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:36.538490 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69809b7d-72e3-4ad9-a943-529b5112f8e7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:36.538948 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69809b7d-72e3-4ad9-a943-529b5112f8e7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:36.539800 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69809b7d-72e3-4ad9-a943-529b5112f8e7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:36.540248 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-69809b7d-72e3-4ad9-a943-529b5112f8e7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:36.718444 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-69809b7d-72e3-4ad9-a943-529b5112f8e7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:36.729217 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-69809b7d-72e3-4ad9-a943-529b5112f8e7 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1317 microversion: 2.1 time: 0.203009 Nov 24 16:07:36.729981 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 175/362] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:36 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:37.010952 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e26ad518-84d0-4f9b-8a8e-aef5a7345bb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:37.012412 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e26ad518-84d0-4f9b-8a8e-aef5a7345bb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:37.023315 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e26ad518-84d0-4f9b-8a8e-aef5a7345bb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:37.033398 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4ba5c4d0-81aa-4eed-9223-99e3599baf4c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:37.034959 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4ba5c4d0-81aa-4eed-9223-99e3599baf4c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:37.037615 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e26ad518-84d0-4f9b-8a8e-aef5a7345bb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:37.038998 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e26ad518-84d0-4f9b-8a8e-aef5a7345bb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:37.039608 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e26ad518-84d0-4f9b-8a8e-aef5a7345bb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:37.050683 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ba5c4d0-81aa-4eed-9223-99e3599baf4c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:37.051471 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ba5c4d0-81aa-4eed-9223-99e3599baf4c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:37.052892 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ba5c4d0-81aa-4eed-9223-99e3599baf4c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:37.053696 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ba5c4d0-81aa-4eed-9223-99e3599baf4c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:37.155330 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e26ad518-84d0-4f9b-8a8e-aef5a7345bb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.150618 Nov 24 16:07:37.156576 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 188/363] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:37 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:37.184367 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4ba5c4d0-81aa-4eed-9223-99e3599baf4c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.157620 Nov 24 16:07:37.185383 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 176/364] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:37 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:37.399796 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b1244b0c-3a0f-4540-956b-37878f60e784 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:37.400294 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b1244b0c-3a0f-4540-956b-37878f60e784 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:37.408737 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b1244b0c-3a0f-4540-956b-37878f60e784 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:37.409249 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b1244b0c-3a0f-4540-956b-37878f60e784 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:37.410011 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b1244b0c-3a0f-4540-956b-37878f60e784 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:37.410441 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b1244b0c-3a0f-4540-956b-37878f60e784 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:37.619417 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b1244b0c-3a0f-4540-956b-37878f60e784 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:37.627367 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b1244b0c-3a0f-4540-956b-37878f60e784 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.232515 Nov 24 16:07:37.627957 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 189/365] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:37 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:07:37.748562 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-db165617-5992-4108-aabd-dd6f61c98c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:37.749372 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-db165617-5992-4108-aabd-dd6f61c98c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:37.757521 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-db165617-5992-4108-aabd-dd6f61c98c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:37.758362 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-db165617-5992-4108-aabd-dd6f61c98c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:37.759497 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-db165617-5992-4108-aabd-dd6f61c98c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:37.760102 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-db165617-5992-4108-aabd-dd6f61c98c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:37.983804 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-db165617-5992-4108-aabd-dd6f61c98c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:37.993479 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-db165617-5992-4108-aabd-dd6f61c98c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1317 microversion: 2.1 time: 0.250019 Nov 24 16:07:37.994183 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 177/366] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:37 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:38.168994 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a8ed359b-cbf8-471c-8bae-bf4107c28c76 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:38.169971 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a8ed359b-cbf8-471c-8bae-bf4107c28c76 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:38.176624 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a8ed359b-cbf8-471c-8bae-bf4107c28c76 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:38.177097 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a8ed359b-cbf8-471c-8bae-bf4107c28c76 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:38.178086 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a8ed359b-cbf8-471c-8bae-bf4107c28c76 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:38.178826 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a8ed359b-cbf8-471c-8bae-bf4107c28c76 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:38.201179 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ab5e9af5-6bc1-40a8-9073-b2c3e6d6e6de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:38.202544 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ab5e9af5-6bc1-40a8-9073-b2c3e6d6e6de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:38.225889 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ab5e9af5-6bc1-40a8-9073-b2c3e6d6e6de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:38.226755 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ab5e9af5-6bc1-40a8-9073-b2c3e6d6e6de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:38.228537 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ab5e9af5-6bc1-40a8-9073-b2c3e6d6e6de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:38.229512 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ab5e9af5-6bc1-40a8-9073-b2c3e6d6e6de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:38.255446 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a8ed359b-cbf8-471c-8bae-bf4107c28c76 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.088462 Nov 24 16:07:38.255446 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 190/367] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:38 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:38.392657 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ab5e9af5-6bc1-40a8-9073-b2c3e6d6e6de tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.198422 Nov 24 16:07:38.393552 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 178/368] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:38 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:38.646655 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e771c928-84ad-4ff2-8b35-ec2c80053ad0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:38.647268 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e771c928-84ad-4ff2-8b35-ec2c80053ad0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:38.654943 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e771c928-84ad-4ff2-8b35-ec2c80053ad0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:38.655393 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e771c928-84ad-4ff2-8b35-ec2c80053ad0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:38.656213 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e771c928-84ad-4ff2-8b35-ec2c80053ad0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:38.656649 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e771c928-84ad-4ff2-8b35-ec2c80053ad0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:38.809377 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e771c928-84ad-4ff2-8b35-ec2c80053ad0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:38.818129 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e771c928-84ad-4ff2-8b35-ec2c80053ad0 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.176315 Nov 24 16:07:38.818805 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 191/369] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:38 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:39.014225 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-848abb7d-7ba8-42d5-925e-32df88629103 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:39.015047 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-848abb7d-7ba8-42d5-925e-32df88629103 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:39.025722 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-848abb7d-7ba8-42d5-925e-32df88629103 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:39.026470 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-848abb7d-7ba8-42d5-925e-32df88629103 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:39.028132 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-848abb7d-7ba8-42d5-925e-32df88629103 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:39.028771 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-848abb7d-7ba8-42d5-925e-32df88629103 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:39.214211 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-848abb7d-7ba8-42d5-925e-32df88629103 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:39.224051 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-848abb7d-7ba8-42d5-925e-32df88629103 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1317 microversion: 2.1 time: 0.214152 Nov 24 16:07:39.224662 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 179/370] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:39 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:39.266104 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4188a628-cd9c-4daa-a367-317defd7ced8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:39.267174 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4188a628-cd9c-4daa-a367-317defd7ced8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:39.275537 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4188a628-cd9c-4daa-a367-317defd7ced8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:39.276005 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4188a628-cd9c-4daa-a367-317defd7ced8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:39.276973 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4188a628-cd9c-4daa-a367-317defd7ced8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:39.277754 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4188a628-cd9c-4daa-a367-317defd7ced8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:39.409198 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d6d99279-45fc-4df5-99c4-de3796e80a62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:39.411089 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d6d99279-45fc-4df5-99c4-de3796e80a62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:39.424527 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d6d99279-45fc-4df5-99c4-de3796e80a62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:39.425286 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d6d99279-45fc-4df5-99c4-de3796e80a62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:39.426676 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d6d99279-45fc-4df5-99c4-de3796e80a62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:39.428459 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d6d99279-45fc-4df5-99c4-de3796e80a62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:39.433589 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4188a628-cd9c-4daa-a367-317defd7ced8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.170697 Nov 24 16:07:39.440669 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 192/371] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:39 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:07:39.529894 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d6d99279-45fc-4df5-99c4-de3796e80a62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.128403 Nov 24 16:07:39.530602 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 180/372] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:39 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:39.841571 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4d217f89-7a95-4c06-b767-e6ceb63f8a68 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:39.842887 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4d217f89-7a95-4c06-b767-e6ceb63f8a68 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:39.856573 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4d217f89-7a95-4c06-b767-e6ceb63f8a68 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:39.857392 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4d217f89-7a95-4c06-b767-e6ceb63f8a68 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:39.858842 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4d217f89-7a95-4c06-b767-e6ceb63f8a68 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:39.859439 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4d217f89-7a95-4c06-b767-e6ceb63f8a68 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:40.050419 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4d217f89-7a95-4c06-b767-e6ceb63f8a68 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:40.063791 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4d217f89-7a95-4c06-b767-e6ceb63f8a68 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.230505 Nov 24 16:07:40.064774 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 193/373] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:39 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:40.245528 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-63e90349-1dde-405f-8ad5-2b1d4bbfebe8 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:40.247244 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-63e90349-1dde-405f-8ad5-2b1d4bbfebe8 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:40.257522 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63e90349-1dde-405f-8ad5-2b1d4bbfebe8 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:40.258528 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63e90349-1dde-405f-8ad5-2b1d4bbfebe8 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:40.260247 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63e90349-1dde-405f-8ad5-2b1d4bbfebe8 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:40.260682 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-63e90349-1dde-405f-8ad5-2b1d4bbfebe8 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:40.458395 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e18eb406-b9a9-4cff-a299-ea7ca9018c5d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:40.459509 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e18eb406-b9a9-4cff-a299-ea7ca9018c5d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:40.466848 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e18eb406-b9a9-4cff-a299-ea7ca9018c5d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:40.468541 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-63e90349-1dde-405f-8ad5-2b1d4bbfebe8 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:40.468699 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e18eb406-b9a9-4cff-a299-ea7ca9018c5d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:40.469632 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e18eb406-b9a9-4cff-a299-ea7ca9018c5d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:40.470168 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e18eb406-b9a9-4cff-a299-ea7ca9018c5d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:40.482901 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-63e90349-1dde-405f-8ad5-2b1d4bbfebe8 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1317 microversion: 2.1 time: 0.243547 Nov 24 16:07:40.483967 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 181/374] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:40 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:40.543537 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ffd10003-0e8d-4445-8648-b99446e9ad4f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:40.544517 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ffd10003-0e8d-4445-8648-b99446e9ad4f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:40.551553 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffd10003-0e8d-4445-8648-b99446e9ad4f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:40.552131 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffd10003-0e8d-4445-8648-b99446e9ad4f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:40.552946 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffd10003-0e8d-4445-8648-b99446e9ad4f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:40.553495 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffd10003-0e8d-4445-8648-b99446e9ad4f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:40.554933 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e18eb406-b9a9-4cff-a299-ea7ca9018c5d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.111114 Nov 24 16:07:40.556577 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 194/375] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:40 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:40.638183 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ffd10003-0e8d-4445-8648-b99446e9ad4f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.099776 Nov 24 16:07:40.638885 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 182/376] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:40 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:41.092793 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2ccac5a3-0fd7-47e2-9ae1-e6eabd78e70f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:41.093528 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2ccac5a3-0fd7-47e2-9ae1-e6eabd78e70f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:41.100812 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ccac5a3-0fd7-47e2-9ae1-e6eabd78e70f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:41.101290 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ccac5a3-0fd7-47e2-9ae1-e6eabd78e70f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:41.102698 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ccac5a3-0fd7-47e2-9ae1-e6eabd78e70f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:41.103142 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ccac5a3-0fd7-47e2-9ae1-e6eabd78e70f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:41.279682 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-2ccac5a3-0fd7-47e2-9ae1-e6eabd78e70f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:41.289571 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2ccac5a3-0fd7-47e2-9ae1-e6eabd78e70f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.201750 Nov 24 16:07:41.290163 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 195/377] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:41 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:41.394228 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-6ef74acd-720c-4f8d-a675-d2ed1bed502e req-3ff1abe0-137e-4922-adb0-3b2c8b177326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0795a5-a12b-487a-8717-c9e4c33bd48c", "name": "network-vif-plugged", "status": "completed", "tag": "f6b62b55-c282-46ef-a9ba-700f74a8fa81"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:41.396869 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:07:41.396869 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:07:41.421085 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-6ef74acd-720c-4f8d-a675-d2ed1bed502e req-3ff1abe0-137e-4922-adb0-3b2c8b177326 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:41.421524 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-6ef74acd-720c-4f8d-a675-d2ed1bed502e req-3ff1abe0-137e-4922-adb0-3b2c8b177326 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:41.437060 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-6ef74acd-720c-4f8d-a675-d2ed1bed502e req-3ff1abe0-137e-4922-adb0-3b2c8b177326 service nova] Creating event network-vif-plugged:f6b62b55-c282-46ef-a9ba-700f74a8fa81 for instance 5d0795a5-a12b-487a-8717-c9e4c33bd48c on hv-cinder-81899 Nov 24 16:07:41.442135 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-6ef74acd-720c-4f8d-a675-d2ed1bed502e req-3ff1abe0-137e-4922-adb0-3b2c8b177326 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055842 Nov 24 16:07:41.442901 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 183/378] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:07:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:07:41.506082 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-86530617-e7d5-47ee-8c6f-f00655c8142a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:41.506872 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-86530617-e7d5-47ee-8c6f-f00655c8142a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:41.514490 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-86530617-e7d5-47ee-8c6f-f00655c8142a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:41.514951 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-86530617-e7d5-47ee-8c6f-f00655c8142a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:41.515942 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-86530617-e7d5-47ee-8c6f-f00655c8142a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:41.516671 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-86530617-e7d5-47ee-8c6f-f00655c8142a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:41.571891 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fefb34d2-3450-4b4b-9bf0-e08e70e55cad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:41.573966 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fefb34d2-3450-4b4b-9bf0-e08e70e55cad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:41.594889 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fefb34d2-3450-4b4b-9bf0-e08e70e55cad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:41.595931 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fefb34d2-3450-4b4b-9bf0-e08e70e55cad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:41.597073 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fefb34d2-3450-4b4b-9bf0-e08e70e55cad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:41.607419 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fefb34d2-3450-4b4b-9bf0-e08e70e55cad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:41.719628 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fefb34d2-3450-4b4b-9bf0-e08e70e55cad tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.154315 Nov 24 16:07:41.720678 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 184/379] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:41 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:41.728656 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8d58ccd0-5dd5-4c4a-bdc6-6856de29a6df tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:41.729914 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8d58ccd0-5dd5-4c4a-bdc6-6856de29a6df tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:41.736324 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-86530617-e7d5-47ee-8c6f-f00655c8142a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:41.741512 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8d58ccd0-5dd5-4c4a-bdc6-6856de29a6df tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:41.742573 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8d58ccd0-5dd5-4c4a-bdc6-6856de29a6df tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:41.743959 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8d58ccd0-5dd5-4c4a-bdc6-6856de29a6df tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:41.744590 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8d58ccd0-5dd5-4c4a-bdc6-6856de29a6df tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:41.748434 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-86530617-e7d5-47ee-8c6f-f00655c8142a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1317 microversion: 2.1 time: 0.250217 Nov 24 16:07:41.761431 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 196/380] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:41 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:07:41.824121 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8d58ccd0-5dd5-4c4a-bdc6-6856de29a6df tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.101070 Nov 24 16:07:41.825651 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 185/381] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:41 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:42.314694 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fdd32f20-0724-40bb-8e74-c42961dbc12e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:42.315695 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fdd32f20-0724-40bb-8e74-c42961dbc12e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:42.324069 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fdd32f20-0724-40bb-8e74-c42961dbc12e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:42.324790 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fdd32f20-0724-40bb-8e74-c42961dbc12e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:42.325831 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fdd32f20-0724-40bb-8e74-c42961dbc12e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:42.326896 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fdd32f20-0724-40bb-8e74-c42961dbc12e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:42.628727 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-fdd32f20-0724-40bb-8e74-c42961dbc12e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:42.643826 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fdd32f20-0724-40bb-8e74-c42961dbc12e tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1501 microversion: 2.1 time: 0.332512 Nov 24 16:07:42.644928 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 197/382] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:42 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1501 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:42.677376 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6918de74-b7a0-460e-97e4-f7d1095db53f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76bc4a81-c6d6-46da-89ef-5888763bd2de"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:42.688910 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6918de74-b7a0-460e-97e4-f7d1095db53f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:42.704666 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6918de74-b7a0-460e-97e4-f7d1095db53f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:42.705254 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6918de74-b7a0-460e-97e4-f7d1095db53f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:42.705986 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6918de74-b7a0-460e-97e4-f7d1095db53f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:42.706542 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6918de74-b7a0-460e-97e4-f7d1095db53f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:42.737452 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-aec34c5e-deb8-4088-88f1-c47be67791e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:42.738956 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-aec34c5e-deb8-4088-88f1-c47be67791e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:42.746557 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aec34c5e-deb8-4088-88f1-c47be67791e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:42.747408 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aec34c5e-deb8-4088-88f1-c47be67791e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:42.748327 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aec34c5e-deb8-4088-88f1-c47be67791e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:42.748925 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aec34c5e-deb8-4088-88f1-c47be67791e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:42.757442 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-6918de74-b7a0-460e-97e4-f7d1095db53f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] HTTP exception thrown: Cannot 'attach_volume' instance a3a9b563-1f54-4c61-923f-9b557a3c307b while it is in vm_state rescued Nov 24 16:07:42.760569 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6918de74-b7a0-460e-97e4-f7d1095db53f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Returning 409 to user: Cannot 'attach_volume' instance a3a9b563-1f54-4c61-923f-9b557a3c307b while it is in vm_state rescued {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:07:42.762500 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6918de74-b7a0-460e-97e4-f7d1095db53f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "POST /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.094360 Nov 24 16:07:42.764360 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 186/383] 10.222.0.72 () {60 vars in 1322 bytes} [Wed Nov 24 16:07:42 2021] POST /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/os-volume_attachments => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 24 16:07:42.772276 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-39add02f-885f-48b3-bfa0-24355b0cb7f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:42.775665 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-39add02f-885f-48b3-bfa0-24355b0cb7f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:42.784234 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-39add02f-885f-48b3-bfa0-24355b0cb7f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:42.785064 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-39add02f-885f-48b3-bfa0-24355b0cb7f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:42.786174 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-39add02f-885f-48b3-bfa0-24355b0cb7f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:42.786791 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-39add02f-885f-48b3-bfa0-24355b0cb7f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:42.845216 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-aec34c5e-deb8-4088-88f1-c47be67791e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.114666 Nov 24 16:07:42.847019 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 198/384] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:42 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:42.853559 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-816488fb-3e30-4b45-8b15-c6929b02f5f4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:42.854187 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-816488fb-3e30-4b45-8b15-c6929b02f5f4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:42.861749 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-816488fb-3e30-4b45-8b15-c6929b02f5f4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:42.862196 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-816488fb-3e30-4b45-8b15-c6929b02f5f4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:42.862997 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-816488fb-3e30-4b45-8b15-c6929b02f5f4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:42.863427 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-816488fb-3e30-4b45-8b15-c6929b02f5f4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:42.964578 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-816488fb-3e30-4b45-8b15-c6929b02f5f4 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "POST /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/action" status: 202 len: 0 microversion: 2.1 time: 0.115940 Nov 24 16:07:42.965551 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 199/385] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:42 2021] POST /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:42.971579 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-07c60821-a7f0-4b2f-9da2-6f3b199f6e08 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:42.972606 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-07c60821-a7f0-4b2f-9da2-6f3b199f6e08 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:42.980467 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-07c60821-a7f0-4b2f-9da2-6f3b199f6e08 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:42.980925 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-07c60821-a7f0-4b2f-9da2-6f3b199f6e08 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:42.981945 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-07c60821-a7f0-4b2f-9da2-6f3b199f6e08 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:42.982396 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-07c60821-a7f0-4b2f-9da2-6f3b199f6e08 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:43.014375 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-39add02f-885f-48b3-bfa0-24355b0cb7f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:43.029902 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-39add02f-885f-48b3-bfa0-24355b0cb7f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1317 microversion: 2.1 time: 0.263288 Nov 24 16:07:43.037267 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 187/386] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:42 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:43.045535 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-001e657a-7ffa-429a-b634-530008eaf732 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:43.046484 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-001e657a-7ffa-429a-b634-530008eaf732 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:43.053012 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-001e657a-7ffa-429a-b634-530008eaf732 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:43.053969 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-001e657a-7ffa-429a-b634-530008eaf732 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:43.055975 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-001e657a-7ffa-429a-b634-530008eaf732 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:43.056690 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-001e657a-7ffa-429a-b634-530008eaf732 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:43.063577 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-07c60821-a7f0-4b2f-9da2-6f3b199f6e08 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.095945 Nov 24 16:07:43.065207 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 200/387] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:42 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:43.350901 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-001e657a-7ffa-429a-b634-530008eaf732 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:43.365277 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-001e657a-7ffa-429a-b634-530008eaf732 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1509 microversion: 2.1 time: 0.326560 Nov 24 16:07:43.366218 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 188/388] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:43 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1509 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:43.867040 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-45b78dfd-765b-4c49-be36-e747f8b3edd2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:43.868958 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-45b78dfd-765b-4c49-be36-e747f8b3edd2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:43.920891 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-45b78dfd-765b-4c49-be36-e747f8b3edd2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:43.921872 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-45b78dfd-765b-4c49-be36-e747f8b3edd2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:43.923431 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-45b78dfd-765b-4c49-be36-e747f8b3edd2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:43.927344 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-45b78dfd-765b-4c49-be36-e747f8b3edd2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:44.047210 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-45b78dfd-765b-4c49-be36-e747f8b3edd2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28165 microversion: 2.20 time: 0.191428 Nov 24 16:07:44.057473 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 201/389] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:43 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28165 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:44.058497 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-83ff521f-484a-4a2a-a6c7-ed37d81e2a47 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:44.060445 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-83ff521f-484a-4a2a-a6c7-ed37d81e2a47 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:44.082262 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d76b7519-c85f-4e17-9087-d58bf1210c6d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:44.084275 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d76b7519-c85f-4e17-9087-d58bf1210c6d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:44.088987 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-83ff521f-484a-4a2a-a6c7-ed37d81e2a47 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:44.090422 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-83ff521f-484a-4a2a-a6c7-ed37d81e2a47 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:44.092058 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-83ff521f-484a-4a2a-a6c7-ed37d81e2a47 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:44.092929 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-83ff521f-484a-4a2a-a6c7-ed37d81e2a47 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:44.109272 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d76b7519-c85f-4e17-9087-d58bf1210c6d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:44.110770 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d76b7519-c85f-4e17-9087-d58bf1210c6d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:44.115082 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d76b7519-c85f-4e17-9087-d58bf1210c6d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:44.119194 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d76b7519-c85f-4e17-9087-d58bf1210c6d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:44.207603 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d76b7519-c85f-4e17-9087-d58bf1210c6d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.132337 Nov 24 16:07:44.212999 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 202/390] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:44 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:44.351990 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-83ff521f-484a-4a2a-a6c7-ed37d81e2a47 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:44.361857 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-83ff521f-484a-4a2a-a6c7-ed37d81e2a47 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1507 microversion: 2.1 time: 0.310050 Nov 24 16:07:44.361857 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 189/391] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:44 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1507 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:44.403084 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-bf4e8e6d-9481-42a7-8aa7-74551d47d106 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:44.404789 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-bf4e8e6d-9481-42a7-8aa7-74551d47d106 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:44.422898 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bf4e8e6d-9481-42a7-8aa7-74551d47d106 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:44.424261 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bf4e8e6d-9481-42a7-8aa7-74551d47d106 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:44.426525 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bf4e8e6d-9481-42a7-8aa7-74551d47d106 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:44.427836 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bf4e8e6d-9481-42a7-8aa7-74551d47d106 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:45.068396 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-29e1a9c6-10fe-4a40-857d-0226cb210052 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:45.071912 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-29e1a9c6-10fe-4a40-857d-0226cb210052 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:45.079355 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-29e1a9c6-10fe-4a40-857d-0226cb210052 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:45.080119 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-29e1a9c6-10fe-4a40-857d-0226cb210052 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:45.081446 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-29e1a9c6-10fe-4a40-857d-0226cb210052 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:45.082097 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-29e1a9c6-10fe-4a40-857d-0226cb210052 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:45.124821 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-bf4e8e6d-9481-42a7-8aa7-74551d47d106 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:45.133669 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-bf4e8e6d-9481-42a7-8aa7-74551d47d106 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1509 microversion: 2.1 time: 0.741804 Nov 24 16:07:45.134710 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 203/392] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:44 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1509 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:07:45.171886 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-29e1a9c6-10fe-4a40-857d-0226cb210052 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28456 microversion: 2.20 time: 0.113204 Nov 24 16:07:45.178518 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 190/393] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:45 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28456 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:45.228142 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0b3cc722-7115-4f7c-95e2-167a062b4d3f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:45.231245 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0b3cc722-7115-4f7c-95e2-167a062b4d3f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:45.241889 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0b3cc722-7115-4f7c-95e2-167a062b4d3f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:45.243029 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0b3cc722-7115-4f7c-95e2-167a062b4d3f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:45.244155 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0b3cc722-7115-4f7c-95e2-167a062b4d3f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:45.244687 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0b3cc722-7115-4f7c-95e2-167a062b4d3f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:45.349222 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0b3cc722-7115-4f7c-95e2-167a062b4d3f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.130584 Nov 24 16:07:45.357099 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 204/394] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:45 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:45.934694 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c00b9757-e0fa-4d78-937e-2f8a2b6aec3f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c449b25-3a38-409a-a204-21384e988ed8"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:45.935872 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c00b9757-e0fa-4d78-937e-2f8a2b6aec3f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:45.952006 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c00b9757-e0fa-4d78-937e-2f8a2b6aec3f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:45.953060 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c00b9757-e0fa-4d78-937e-2f8a2b6aec3f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:45.954350 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c00b9757-e0fa-4d78-937e-2f8a2b6aec3f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:45.955063 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c00b9757-e0fa-4d78-937e-2f8a2b6aec3f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:46.158608 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-38b40e74-89ea-4848-85ae-c243c54619d9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:46.161122 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-38b40e74-89ea-4848-85ae-c243c54619d9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:46.188589 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-38b40e74-89ea-4848-85ae-c243c54619d9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:46.191887 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-38b40e74-89ea-4848-85ae-c243c54619d9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:46.198898 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-38b40e74-89ea-4848-85ae-c243c54619d9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:46.203948 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-38b40e74-89ea-4848-85ae-c243c54619d9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:46.386976 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c00b9757-e0fa-4d78-937e-2f8a2b6aec3f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "POST /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.456714 Nov 24 16:07:46.398040 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 191/395] 10.222.0.72 () {60 vars in 1322 bytes} [Wed Nov 24 16:07:45 2021] POST /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:07:46.408554 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a21c787a-08a5-425c-81d2-01e007ce1809 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:46.416309 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a21c787a-08a5-425c-81d2-01e007ce1809 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:46.432521 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a21c787a-08a5-425c-81d2-01e007ce1809 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:46.432984 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a21c787a-08a5-425c-81d2-01e007ce1809 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:46.433946 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a21c787a-08a5-425c-81d2-01e007ce1809 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:46.434446 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a21c787a-08a5-425c-81d2-01e007ce1809 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:46.481800 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-38b40e74-89ea-4848-85ae-c243c54619d9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:46.501687 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-38b40e74-89ea-4848-85ae-c243c54619d9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1509 microversion: 2.1 time: 0.349752 Nov 24 16:07:46.516842 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 205/396] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:46 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1509 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:46.522361 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a6d76d84-9cce-44f9-9a44-40497332d199 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:46.523582 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a6d76d84-9cce-44f9-9a44-40497332d199 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:46.542942 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a6d76d84-9cce-44f9-9a44-40497332d199 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:46.543447 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a6d76d84-9cce-44f9-9a44-40497332d199 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:46.546858 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a6d76d84-9cce-44f9-9a44-40497332d199 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:46.547702 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a6d76d84-9cce-44f9-9a44-40497332d199 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:46.579502 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a21c787a-08a5-425c-81d2-01e007ce1809 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28456 microversion: 2.20 time: 0.182901 Nov 24 16:07:46.580527 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 192/397] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:46 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28456 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:46.653271 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a6d76d84-9cce-44f9-9a44-40497332d199 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28176 microversion: 2.1 time: 0.130510 Nov 24 16:07:46.659641 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 206/398] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:46 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28176 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:47.533349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-57dc8883-73f8-44a9-b3e0-ca6e1bdb6153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:47.533349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-57dc8883-73f8-44a9-b3e0-ca6e1bdb6153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:47.542792 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-57dc8883-73f8-44a9-b3e0-ca6e1bdb6153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:47.543105 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-57dc8883-73f8-44a9-b3e0-ca6e1bdb6153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:47.543952 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-57dc8883-73f8-44a9-b3e0-ca6e1bdb6153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:47.544401 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-57dc8883-73f8-44a9-b3e0-ca6e1bdb6153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:47.593216 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2a3a5727-c74a-4052-9757-dffa76630ebb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:47.594245 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2a3a5727-c74a-4052-9757-dffa76630ebb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:47.602161 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2a3a5727-c74a-4052-9757-dffa76630ebb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:47.602649 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2a3a5727-c74a-4052-9757-dffa76630ebb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:47.603525 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2a3a5727-c74a-4052-9757-dffa76630ebb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:47.603965 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2a3a5727-c74a-4052-9757-dffa76630ebb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:47.706118 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2a3a5727-c74a-4052-9757-dffa76630ebb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.117416 Nov 24 16:07:47.708313 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 207/399] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:47 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:47.717469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4e54c498-f02b-49bf-a5cc-107149efff27 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:47.719047 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4e54c498-f02b-49bf-a5cc-107149efff27 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:47.729546 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4e54c498-f02b-49bf-a5cc-107149efff27 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:47.729971 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4e54c498-f02b-49bf-a5cc-107149efff27 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:47.733507 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4e54c498-f02b-49bf-a5cc-107149efff27 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:47.734024 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4e54c498-f02b-49bf-a5cc-107149efff27 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:47.862307 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4e54c498-f02b-49bf-a5cc-107149efff27 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28467 microversion: 2.1 time: 0.151991 Nov 24 16:07:47.863098 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 208/400] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:47 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28467 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:47.877256 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-57dc8883-73f8-44a9-b3e0-ca6e1bdb6153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:47.893203 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-57dc8883-73f8-44a9-b3e0-ca6e1bdb6153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1515 microversion: 2.1 time: 0.373434 Nov 24 16:07:47.894331 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 193/401] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:47 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1515 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:48.725318 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1182c36e-8ac5-4940-854e-c59e26d12086 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:48.730359 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1182c36e-8ac5-4940-854e-c59e26d12086 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:48.754607 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1182c36e-8ac5-4940-854e-c59e26d12086 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:48.756449 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1182c36e-8ac5-4940-854e-c59e26d12086 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:48.758924 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1182c36e-8ac5-4940-854e-c59e26d12086 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:48.759870 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1182c36e-8ac5-4940-854e-c59e26d12086 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:48.868013 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1182c36e-8ac5-4940-854e-c59e26d12086 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.149259 Nov 24 16:07:48.872146 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 209/402] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:48 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:48.886028 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e64fbf79-8e86-4be0-824e-addc34becbe0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:48.890717 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e64fbf79-8e86-4be0-824e-addc34becbe0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:48.905161 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e64fbf79-8e86-4be0-824e-addc34becbe0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:48.906736 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e64fbf79-8e86-4be0-824e-addc34becbe0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:48.909098 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e64fbf79-8e86-4be0-824e-addc34becbe0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:48.910179 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e64fbf79-8e86-4be0-824e-addc34becbe0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:49.038841 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e64fbf79-8e86-4be0-824e-addc34becbe0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28520 microversion: 2.1 time: 0.162663 Nov 24 16:07:49.045414 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 194/403] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:48 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:49.445610 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-50e89aa6-ef81-423c-92e2-284f5f9c29ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:49.446648 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-50e89aa6-ef81-423c-92e2-284f5f9c29ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:49.456803 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-50e89aa6-ef81-423c-92e2-284f5f9c29ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:49.458656 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-50e89aa6-ef81-423c-92e2-284f5f9c29ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:49.460072 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-50e89aa6-ef81-423c-92e2-284f5f9c29ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:49.460936 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-50e89aa6-ef81-423c-92e2-284f5f9c29ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:49.827358 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-50e89aa6-ef81-423c-92e2-284f5f9c29ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:07:49.839348 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-50e89aa6-ef81-423c-92e2-284f5f9c29ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1515 microversion: 2.1 time: 0.397964 Nov 24 16:07:49.850965 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 210/404] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:07:49 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1515 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:07:49.863417 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-42c7a0ee-0046-4522-8bea-e68c955a771a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76ef1c99-a8d1-4a57-aede-2cc6c3fc7f58"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:49.865605 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-42c7a0ee-0046-4522-8bea-e68c955a771a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:49.883990 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ddacf49a-40d7-46e0-b1f5-b48aadd6e963 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:49.886131 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ddacf49a-40d7-46e0-b1f5-b48aadd6e963 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:49.892393 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-42c7a0ee-0046-4522-8bea-e68c955a771a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:49.893576 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-42c7a0ee-0046-4522-8bea-e68c955a771a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:49.894645 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-42c7a0ee-0046-4522-8bea-e68c955a771a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:49.895421 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-42c7a0ee-0046-4522-8bea-e68c955a771a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:49.896643 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ddacf49a-40d7-46e0-b1f5-b48aadd6e963 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:49.898000 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ddacf49a-40d7-46e0-b1f5-b48aadd6e963 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:49.899529 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ddacf49a-40d7-46e0-b1f5-b48aadd6e963 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:49.902647 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ddacf49a-40d7-46e0-b1f5-b48aadd6e963 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:49.992704 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ddacf49a-40d7-46e0-b1f5-b48aadd6e963 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.112973 Nov 24 16:07:49.995263 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 211/405] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:49 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:50.058197 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-bf4a0c7e-1781-4335-9c67-4cdb4bb16a03 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:50.061446 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-bf4a0c7e-1781-4335-9c67-4cdb4bb16a03 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:50.074391 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bf4a0c7e-1781-4335-9c67-4cdb4bb16a03 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:50.077691 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bf4a0c7e-1781-4335-9c67-4cdb4bb16a03 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:50.078664 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bf4a0c7e-1781-4335-9c67-4cdb4bb16a03 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:50.079105 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bf4a0c7e-1781-4335-9c67-4cdb4bb16a03 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:50.208831 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-bf4a0c7e-1781-4335-9c67-4cdb4bb16a03 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.155060 Nov 24 16:07:50.209877 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 212/406] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:50 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:50.475696 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-42c7a0ee-0046-4522-8bea-e68c955a771a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "POST /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.620752 Nov 24 16:07:50.478936 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 195/407] 10.222.0.72 () {60 vars in 1322 bytes} [Wed Nov 24 16:07:49 2021] POST /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/os-volume_attachments => generated 194 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:07:51.014338 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-942e8e68-0cc0-4cc2-880c-3cb4c937a9b6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:51.016299 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-942e8e68-0cc0-4cc2-880c-3cb4c937a9b6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:51.029671 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-942e8e68-0cc0-4cc2-880c-3cb4c937a9b6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:51.030486 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-942e8e68-0cc0-4cc2-880c-3cb4c937a9b6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:51.031934 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-942e8e68-0cc0-4cc2-880c-3cb4c937a9b6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:51.032740 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-942e8e68-0cc0-4cc2-880c-3cb4c937a9b6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:51.126436 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-942e8e68-0cc0-4cc2-880c-3cb4c937a9b6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.120871 Nov 24 16:07:51.127441 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 213/408] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:51 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:07:51.231308 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fb500f77-27d6-4574-805a-93feb1c8563a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:51.232391 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fb500f77-27d6-4574-805a-93feb1c8563a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:51.240637 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fb500f77-27d6-4574-805a-93feb1c8563a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:51.241783 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fb500f77-27d6-4574-805a-93feb1c8563a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:51.243400 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fb500f77-27d6-4574-805a-93feb1c8563a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:51.244188 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fb500f77-27d6-4574-805a-93feb1c8563a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:51.331840 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fb500f77-27d6-4574-805a-93feb1c8563a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.104662 Nov 24 16:07:51.331840 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 196/409] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:51 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:52.146153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-def6410a-047f-4e71-b57a-236d249af245 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:52.149442 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-def6410a-047f-4e71-b57a-236d249af245 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:52.169447 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-def6410a-047f-4e71-b57a-236d249af245 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:52.170176 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-def6410a-047f-4e71-b57a-236d249af245 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:52.171200 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-def6410a-047f-4e71-b57a-236d249af245 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:52.171856 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-def6410a-047f-4e71-b57a-236d249af245 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:52.290672 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-def6410a-047f-4e71-b57a-236d249af245 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.150667 Nov 24 16:07:52.306576 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 214/410] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:52 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:52.350591 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9198511d-8a9a-4dda-ac45-623a1acdb1bd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:52.353319 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9198511d-8a9a-4dda-ac45-623a1acdb1bd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:52.365570 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9198511d-8a9a-4dda-ac45-623a1acdb1bd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:52.365570 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9198511d-8a9a-4dda-ac45-623a1acdb1bd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:52.366490 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9198511d-8a9a-4dda-ac45-623a1acdb1bd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:52.369018 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9198511d-8a9a-4dda-ac45-623a1acdb1bd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:52.446138 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9198511d-8a9a-4dda-ac45-623a1acdb1bd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.103677 Nov 24 16:07:52.447395 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 197/411] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:52 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:53.323291 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-545c4630-bc0f-41b9-bcae-0beac6e41659 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:53.325616 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-545c4630-bc0f-41b9-bcae-0beac6e41659 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:53.342405 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-545c4630-bc0f-41b9-bcae-0beac6e41659 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:53.342753 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-545c4630-bc0f-41b9-bcae-0beac6e41659 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:53.344067 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-545c4630-bc0f-41b9-bcae-0beac6e41659 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:53.344732 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-545c4630-bc0f-41b9-bcae-0beac6e41659 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:53.419601 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-545c4630-bc0f-41b9-bcae-0beac6e41659 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.107548 Nov 24 16:07:53.421398 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 215/412] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:53 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:07:53.480234 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-12c3dd0d-0b84-41b7-b8fb-761bc689b248 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:53.483440 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-12c3dd0d-0b84-41b7-b8fb-761bc689b248 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:53.515182 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-12c3dd0d-0b84-41b7-b8fb-761bc689b248 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:53.516518 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-12c3dd0d-0b84-41b7-b8fb-761bc689b248 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:53.521583 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-12c3dd0d-0b84-41b7-b8fb-761bc689b248 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:53.524420 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-12c3dd0d-0b84-41b7-b8fb-761bc689b248 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:53.690812 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-12c3dd0d-0b84-41b7-b8fb-761bc689b248 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.232132 Nov 24 16:07:53.692320 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 198/413] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:53 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:54.440786 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-02fc899f-4d9e-4f12-8013-179f97d8ada8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:54.449836 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-02fc899f-4d9e-4f12-8013-179f97d8ada8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:54.484339 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-02fc899f-4d9e-4f12-8013-179f97d8ada8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:54.485828 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-02fc899f-4d9e-4f12-8013-179f97d8ada8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:54.488026 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-02fc899f-4d9e-4f12-8013-179f97d8ada8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:54.490280 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-02fc899f-4d9e-4f12-8013-179f97d8ada8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:54.651361 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-02fc899f-4d9e-4f12-8013-179f97d8ada8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.219186 Nov 24 16:07:54.658629 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 216/414] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:54 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:54.712015 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d0630bf0-d8c4-42df-b1e7-bc1d6df8a2ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:54.714367 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d0630bf0-d8c4-42df-b1e7-bc1d6df8a2ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:54.734520 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d0630bf0-d8c4-42df-b1e7-bc1d6df8a2ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:54.735092 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d0630bf0-d8c4-42df-b1e7-bc1d6df8a2ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:54.736015 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d0630bf0-d8c4-42df-b1e7-bc1d6df8a2ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:54.736555 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d0630bf0-d8c4-42df-b1e7-bc1d6df8a2ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:54.756912 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1b7ad117-3c56-4435-bacc-230b8e3aa60d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c449b25-3a38-409a-a204-21384e988ed8"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:54.765666 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1b7ad117-3c56-4435-bacc-230b8e3aa60d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:54.778018 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1b7ad117-3c56-4435-bacc-230b8e3aa60d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:54.781867 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1b7ad117-3c56-4435-bacc-230b8e3aa60d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:54.787786 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1b7ad117-3c56-4435-bacc-230b8e3aa60d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:54.789723 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1b7ad117-3c56-4435-bacc-230b8e3aa60d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:54.841068 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d0630bf0-d8c4-42df-b1e7-bc1d6df8a2ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.133540 Nov 24 16:07:54.844820 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 199/415] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:54 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:54.959150 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-1b7ad117-3c56-4435-bacc-230b8e3aa60d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] HTTP exception thrown: Invalid volume: volume 0c449b25-3a38-409a-a204-21384e988ed8 is already attached to instances: 5d0795a5-a12b-487a-8717-c9e4c33bd48c Nov 24 16:07:54.959952 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1b7ad117-3c56-4435-bacc-230b8e3aa60d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Returning 400 to user: Invalid volume: volume 0c449b25-3a38-409a-a204-21384e988ed8 is already attached to instances: 5d0795a5-a12b-487a-8717-c9e4c33bd48c {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:07:54.961798 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1b7ad117-3c56-4435-bacc-230b8e3aa60d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "POST /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.217612 Nov 24 16:07:54.963173 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 217/416] 10.222.0.72 () {60 vars in 1322 bytes} [Wed Nov 24 16:07:54 2021] POST /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments => generated 174 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 24 16:07:55.106745 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1a3ae4b3-4d0a-4dfe-9f00-051c9b20cafa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:55.107979 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1a3ae4b3-4d0a-4dfe-9f00-051c9b20cafa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:55.124871 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1a3ae4b3-4d0a-4dfe-9f00-051c9b20cafa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:55.126572 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1a3ae4b3-4d0a-4dfe-9f00-051c9b20cafa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:55.128432 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1a3ae4b3-4d0a-4dfe-9f00-051c9b20cafa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:55.129608 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1a3ae4b3-4d0a-4dfe-9f00-051c9b20cafa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:55.391918 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-1a3ae4b3-4d0a-4dfe-9f00-051c9b20cafa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lazy-loading 'services' on Instance uuid 5d0795a5-a12b-487a-8717-c9e4c33bd48c {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:07:55.523072 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1a3ae4b3-4d0a-4dfe-9f00-051c9b20cafa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "DELETE /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments/0c449b25-3a38-409a-a204-21384e988ed8" status: 202 len: 0 microversion: 2.1 time: 0.424373 Nov 24 16:07:55.525641 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 200/417] 10.222.0.72 () {58 vars in 1415 bytes} [Wed Nov 24 16:07:55 2021] DELETE /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments/0c449b25-3a38-409a-a204-21384e988ed8 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:55.533897 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8838e47f-6eab-4161-894b-6f67e0999720 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:55.534900 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8838e47f-6eab-4161-894b-6f67e0999720 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:55.547477 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8838e47f-6eab-4161-894b-6f67e0999720 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:55.547926 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8838e47f-6eab-4161-894b-6f67e0999720 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:55.550038 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8838e47f-6eab-4161-894b-6f67e0999720 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:55.550765 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8838e47f-6eab-4161-894b-6f67e0999720 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:55.596870 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8838e47f-6eab-4161-894b-6f67e0999720 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067054 Nov 24 16:07:55.597637 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 218/418] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:07:55 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:07:55.670293 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b87b8118-6307-476a-a4f8-47816896ca46 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:55.672554 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b87b8118-6307-476a-a4f8-47816896ca46 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:55.687057 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b87b8118-6307-476a-a4f8-47816896ca46 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:55.687825 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b87b8118-6307-476a-a4f8-47816896ca46 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:55.689536 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b87b8118-6307-476a-a4f8-47816896ca46 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:55.690357 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b87b8118-6307-476a-a4f8-47816896ca46 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:55.795702 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b87b8118-6307-476a-a4f8-47816896ca46 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.132206 Nov 24 16:07:55.799249 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 201/419] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:55 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:55.856672 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-830f7370-4de9-44be-85ab-c12837ff4af6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:55.857652 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-830f7370-4de9-44be-85ab-c12837ff4af6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:55.870471 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-830f7370-4de9-44be-85ab-c12837ff4af6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:55.870922 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-830f7370-4de9-44be-85ab-c12837ff4af6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:55.871750 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-830f7370-4de9-44be-85ab-c12837ff4af6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:55.872182 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-830f7370-4de9-44be-85ab-c12837ff4af6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:55.998318 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-830f7370-4de9-44be-85ab-c12837ff4af6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.143579 Nov 24 16:07:56.002138 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 219/420] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:55 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:56.620380 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e865d7be-3c71-43f3-84e3-fde566c9b956 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:56.622651 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e865d7be-3c71-43f3-84e3-fde566c9b956 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:56.647187 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e865d7be-3c71-43f3-84e3-fde566c9b956 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:56.649676 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e865d7be-3c71-43f3-84e3-fde566c9b956 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:56.651931 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e865d7be-3c71-43f3-84e3-fde566c9b956 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:56.653831 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e865d7be-3c71-43f3-84e3-fde566c9b956 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:56.743751 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e865d7be-3c71-43f3-84e3-fde566c9b956 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134892 Nov 24 16:07:56.745639 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 202/421] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:07:56 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:07:56.822666 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2e61b228-512c-4e63-b7ad-95fc7cf3d1f1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:56.826126 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2e61b228-512c-4e63-b7ad-95fc7cf3d1f1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:56.843716 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2e61b228-512c-4e63-b7ad-95fc7cf3d1f1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:56.844861 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2e61b228-512c-4e63-b7ad-95fc7cf3d1f1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:56.846684 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2e61b228-512c-4e63-b7ad-95fc7cf3d1f1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:56.847932 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2e61b228-512c-4e63-b7ad-95fc7cf3d1f1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:56.938781 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2e61b228-512c-4e63-b7ad-95fc7cf3d1f1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.129617 Nov 24 16:07:56.939749 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 220/422] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:56 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:57.066974 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c58222ab-bbbe-4459-8652-19eebbcb3ea2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:57.070118 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c58222ab-bbbe-4459-8652-19eebbcb3ea2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:57.096050 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c58222ab-bbbe-4459-8652-19eebbcb3ea2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:57.096764 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c58222ab-bbbe-4459-8652-19eebbcb3ea2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:57.098339 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c58222ab-bbbe-4459-8652-19eebbcb3ea2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:57.099076 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c58222ab-bbbe-4459-8652-19eebbcb3ea2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:57.215513 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c58222ab-bbbe-4459-8652-19eebbcb3ea2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.203910 Nov 24 16:07:57.216949 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 203/423] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:57 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:07:57.771873 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7d599c9e-07b4-44f7-8b70-2d6876bfb919 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:57.781942 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7d599c9e-07b4-44f7-8b70-2d6876bfb919 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:57.795510 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7d599c9e-07b4-44f7-8b70-2d6876bfb919 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:57.796154 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7d599c9e-07b4-44f7-8b70-2d6876bfb919 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:57.797224 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7d599c9e-07b4-44f7-8b70-2d6876bfb919 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:57.797817 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7d599c9e-07b4-44f7-8b70-2d6876bfb919 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:57.847570 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7d599c9e-07b4-44f7-8b70-2d6876bfb919 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091187 Nov 24 16:07:57.849117 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 221/424] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:07:57 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:07:57.959630 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7f9774c9-245b-41a6-a9b0-f1284b2950de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:57.962160 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7f9774c9-245b-41a6-a9b0-f1284b2950de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:57.974792 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7f9774c9-245b-41a6-a9b0-f1284b2950de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:57.978818 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7f9774c9-245b-41a6-a9b0-f1284b2950de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:57.981838 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7f9774c9-245b-41a6-a9b0-f1284b2950de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:57.982994 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7f9774c9-245b-41a6-a9b0-f1284b2950de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:58.130574 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7f9774c9-245b-41a6-a9b0-f1284b2950de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.176598 Nov 24 16:07:58.133666 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 204/425] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:57 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:58.229379 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fe94e0f2-7e0c-4ebf-b159-a62951db94eb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:58.230304 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fe94e0f2-7e0c-4ebf-b159-a62951db94eb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:58.243498 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fe94e0f2-7e0c-4ebf-b159-a62951db94eb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:58.243955 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fe94e0f2-7e0c-4ebf-b159-a62951db94eb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:58.250279 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fe94e0f2-7e0c-4ebf-b159-a62951db94eb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:58.250813 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fe94e0f2-7e0c-4ebf-b159-a62951db94eb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:58.411330 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fe94e0f2-7e0c-4ebf-b159-a62951db94eb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.185691 Nov 24 16:07:58.418461 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 222/426] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:58 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:07:58.862911 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-12c55e06-c3b6-43fe-92a4-d2c7b993ea40 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:07:58.864173 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-12c55e06-c3b6-43fe-92a4-d2c7b993ea40 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:58.876537 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-12c55e06-c3b6-43fe-92a4-d2c7b993ea40 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:58.876917 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-12c55e06-c3b6-43fe-92a4-d2c7b993ea40 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:58.878004 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-12c55e06-c3b6-43fe-92a4-d2c7b993ea40 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:58.883660 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-12c55e06-c3b6-43fe-92a4-d2c7b993ea40 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:58.978618 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-12c55e06-c3b6-43fe-92a4-d2c7b993ea40 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121212 Nov 24 16:07:58.991976 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 205/427] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:07:58 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:07:59.158526 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3a09f52f-b07b-4fdd-8755-3eac9472d063 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:59.166446 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3a09f52f-b07b-4fdd-8755-3eac9472d063 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:59.196522 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3a09f52f-b07b-4fdd-8755-3eac9472d063 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:59.198103 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3a09f52f-b07b-4fdd-8755-3eac9472d063 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:59.201078 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3a09f52f-b07b-4fdd-8755-3eac9472d063 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:59.202301 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3a09f52f-b07b-4fdd-8755-3eac9472d063 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:59.315193 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3a09f52f-b07b-4fdd-8755-3eac9472d063 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.169238 Nov 24 16:07:59.322843 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 223/428] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:07:59 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:07:59.424152 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9ba9d18f-0d42-4343-b5e4-6f85bf1e4349 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:07:59.425277 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9ba9d18f-0d42-4343-b5e4-6f85bf1e4349 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:07:59.433698 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9ba9d18f-0d42-4343-b5e4-6f85bf1e4349 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:59.434420 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9ba9d18f-0d42-4343-b5e4-6f85bf1e4349 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:59.435392 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9ba9d18f-0d42-4343-b5e4-6f85bf1e4349 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:07:59.436373 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9ba9d18f-0d42-4343-b5e4-6f85bf1e4349 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:07:59.525175 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9ba9d18f-0d42-4343-b5e4-6f85bf1e4349 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.103956 Nov 24 16:07:59.527828 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 206/429] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:07:59 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:00.010672 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2caf7182-1d41-49c9-a061-d3df831fbf3e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:00.011938 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2caf7182-1d41-49c9-a061-d3df831fbf3e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:00.031717 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2caf7182-1d41-49c9-a061-d3df831fbf3e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:00.032333 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2caf7182-1d41-49c9-a061-d3df831fbf3e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:00.033414 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2caf7182-1d41-49c9-a061-d3df831fbf3e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:00.036970 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2caf7182-1d41-49c9-a061-d3df831fbf3e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:00.078318 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2caf7182-1d41-49c9-a061-d3df831fbf3e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078680 Nov 24 16:08:00.079700 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 224/430] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:07:59 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:08:00.330056 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-28561d6f-2ec0-45c7-a43d-51dd57ebd227 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:00.331470 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-28561d6f-2ec0-45c7-a43d-51dd57ebd227 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:00.349367 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-28561d6f-2ec0-45c7-a43d-51dd57ebd227 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:00.350329 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-28561d6f-2ec0-45c7-a43d-51dd57ebd227 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:00.352461 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-28561d6f-2ec0-45c7-a43d-51dd57ebd227 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:00.353257 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-28561d6f-2ec0-45c7-a43d-51dd57ebd227 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:00.456352 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-28561d6f-2ec0-45c7-a43d-51dd57ebd227 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.129786 Nov 24 16:08:00.470763 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 207/431] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:00 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:00.542099 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c8bab1c1-a458-4090-8a48-3944421b16db tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:00.543071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c8bab1c1-a458-4090-8a48-3944421b16db tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:00.572244 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c8bab1c1-a458-4090-8a48-3944421b16db tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:00.572689 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c8bab1c1-a458-4090-8a48-3944421b16db tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:00.575664 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c8bab1c1-a458-4090-8a48-3944421b16db tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:00.578117 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c8bab1c1-a458-4090-8a48-3944421b16db tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:00.733686 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c8bab1c1-a458-4090-8a48-3944421b16db tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.197570 Nov 24 16:08:00.750823 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 225/432] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:00 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:01.096757 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8fed609e-1639-41ec-a412-45c1d3c75b89 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:01.099322 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8fed609e-1639-41ec-a412-45c1d3c75b89 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:01.109019 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8fed609e-1639-41ec-a412-45c1d3c75b89 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:01.109858 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8fed609e-1639-41ec-a412-45c1d3c75b89 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:01.111138 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8fed609e-1639-41ec-a412-45c1d3c75b89 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:01.111817 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8fed609e-1639-41ec-a412-45c1d3c75b89 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:01.167368 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8fed609e-1639-41ec-a412-45c1d3c75b89 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077422 Nov 24 16:08:01.168377 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 208/433] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:08:01 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:08:01.478952 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-eb5c80b1-a8a3-42a2-ad50-a8be14904029 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:01.480108 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-eb5c80b1-a8a3-42a2-ad50-a8be14904029 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:01.492692 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-eb5c80b1-a8a3-42a2-ad50-a8be14904029 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:01.493483 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-eb5c80b1-a8a3-42a2-ad50-a8be14904029 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:01.495165 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-eb5c80b1-a8a3-42a2-ad50-a8be14904029 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:01.495861 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-eb5c80b1-a8a3-42a2-ad50-a8be14904029 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:01.765480 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-00e88172-1e26-4fca-bd29-5636bcba0f67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:01.770629 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-00e88172-1e26-4fca-bd29-5636bcba0f67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:01.821318 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00e88172-1e26-4fca-bd29-5636bcba0f67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:01.822335 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00e88172-1e26-4fca-bd29-5636bcba0f67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:01.823936 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00e88172-1e26-4fca-bd29-5636bcba0f67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:01.824966 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-00e88172-1e26-4fca-bd29-5636bcba0f67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:01.920716 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-eb5c80b1-a8a3-42a2-ad50-a8be14904029 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.447217 Nov 24 16:08:01.921577 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 226/434] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:01 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:01.956064 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-00e88172-1e26-4fca-bd29-5636bcba0f67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.199851 Nov 24 16:08:01.960436 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 209/435] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:01 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:01.961475 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ccbe286f-2aa7-41c2-b091-2004edd2f20d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:01.962971 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ccbe286f-2aa7-41c2-b091-2004edd2f20d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:01.973502 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ccbe286f-2aa7-41c2-b091-2004edd2f20d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:01.975195 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ccbe286f-2aa7-41c2-b091-2004edd2f20d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:01.978168 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ccbe286f-2aa7-41c2-b091-2004edd2f20d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:01.980032 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ccbe286f-2aa7-41c2-b091-2004edd2f20d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:02.015032 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.objects.instance [None req-ccbe286f-2aa7-41c2-b091-2004edd2f20d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lazy-loading 'flavor' on Instance uuid a3a9b563-1f54-4c61-923f-9b557a3c307b {{(pid=116303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:08:02.223106 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bd1650f7-e720-4456-a3ff-c9efdafc167e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:02.228047 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bd1650f7-e720-4456-a3ff-c9efdafc167e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:02.245456 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bd1650f7-e720-4456-a3ff-c9efdafc167e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:02.246580 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bd1650f7-e720-4456-a3ff-c9efdafc167e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:02.248613 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bd1650f7-e720-4456-a3ff-c9efdafc167e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:02.249724 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bd1650f7-e720-4456-a3ff-c9efdafc167e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:02.275278 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ccbe286f-2aa7-41c2-b091-2004edd2f20d tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "POST /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/action" status: 200 len: 32 microversion: 2.1 time: 0.321093 Nov 24 16:08:02.280904 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 227/436] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:01 2021] POST /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/action => generated 32 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:08:02.305584 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-039d16d8-b33f-47b7-aeec-9b1633b59144 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:02.307598 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-039d16d8-b33f-47b7-aeec-9b1633b59144 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:02.320689 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-039d16d8-b33f-47b7-aeec-9b1633b59144 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:02.321970 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-039d16d8-b33f-47b7-aeec-9b1633b59144 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:02.323994 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-039d16d8-b33f-47b7-aeec-9b1633b59144 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:02.325102 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-039d16d8-b33f-47b7-aeec-9b1633b59144 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:02.328827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bd1650f7-e720-4456-a3ff-c9efdafc167e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.149399 Nov 24 16:08:02.333744 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 210/437] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:08:02 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:08:02.617957 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-937006047", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "networks": [{"uuid": "fafb4435-765d-4616-9638-8248f7ef836b"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:02.686788 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-039d16d8-b33f-47b7-aeec-9b1633b59144 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:02.699753 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-039d16d8-b33f-47b7-aeec-9b1633b59144 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1567 microversion: 2.1 time: 0.410899 Nov 24 16:08:02.700964 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 228/438] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:02 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1567 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:02.790970 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] validate_networks() for [('fafb4435-765d-4616-9638-8248f7ef836b', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:08:02.942035 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-47dfe440-8479-4559-83af-28365a0bf735 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:02.951676 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-47dfe440-8479-4559-83af-28365a0bf735 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:02.987149 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-47dfe440-8479-4559-83af-28365a0bf735 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:02.988462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-47dfe440-8479-4559-83af-28365a0bf735 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:02.992215 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-47dfe440-8479-4559-83af-28365a0bf735 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:02.994693 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-47dfe440-8479-4559-83af-28365a0bf735 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:03.147366 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-47dfe440-8479-4559-83af-28365a0bf735 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.211817 Nov 24 16:08:03.155223 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 229/439] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:02 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:03.168868 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-afd785d1-75ba-4c66-9528-5da5d5a042cc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:03.173127 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-afd785d1-75ba-4c66-9528-5da5d5a042cc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:03.191220 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-afd785d1-75ba-4c66-9528-5da5d5a042cc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:03.192163 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-afd785d1-75ba-4c66-9528-5da5d5a042cc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:03.193929 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-afd785d1-75ba-4c66-9528-5da5d5a042cc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:03.195167 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-afd785d1-75ba-4c66-9528-5da5d5a042cc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:03.326524 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-afd785d1-75ba-4c66-9528-5da5d5a042cc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.166486 Nov 24 16:08:03.331568 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 230/440] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:03 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:03.755358 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-818c879f-461b-4416-94ce-5885e8382499 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:03.756700 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-818c879f-461b-4416-94ce-5885e8382499 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:03.769852 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-818c879f-461b-4416-94ce-5885e8382499 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:03.771045 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-818c879f-461b-4416-94ce-5885e8382499 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:03.773824 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-818c879f-461b-4416-94ce-5885e8382499 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:03.775090 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-818c879f-461b-4416-94ce-5885e8382499 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:04.103083 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-818c879f-461b-4416-94ce-5885e8382499 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:04.121551 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-818c879f-461b-4416-94ce-5885e8382499 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1567 microversion: 2.1 time: 0.376218 Nov 24 16:08:04.122284 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 231/441] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:03 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1567 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:04.164399 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c997ce83-0886-4470-9ee1-9c7fab737ac9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:04.165840 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c997ce83-0886-4470-9ee1-9c7fab737ac9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:04.198871 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c997ce83-0886-4470-9ee1-9c7fab737ac9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:04.200649 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c997ce83-0886-4470-9ee1-9c7fab737ac9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:04.200649 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c997ce83-0886-4470-9ee1-9c7fab737ac9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:04.200968 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c997ce83-0886-4470-9ee1-9c7fab737ac9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:04.332814 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c997ce83-0886-4470-9ee1-9c7fab737ac9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.170248 Nov 24 16:08:04.334425 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 232/442] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:04 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:08:04.356921 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d2f0fc0c-0daa-44ce-a73d-6010ceba4391 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:04.363143 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d2f0fc0c-0daa-44ce-a73d-6010ceba4391 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:04.391358 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d2f0fc0c-0daa-44ce-a73d-6010ceba4391 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:04.393150 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d2f0fc0c-0daa-44ce-a73d-6010ceba4391 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:04.395130 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d2f0fc0c-0daa-44ce-a73d-6010ceba4391 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:04.400286 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d2f0fc0c-0daa-44ce-a73d-6010ceba4391 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:04.472113 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:08:04.475030 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:08:04.476463 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:08:04.477289 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:08:04.477915 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:08:04.490221 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:04.490672 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:04.492151 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:04.492787 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:04.516819 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Getting quotas for project 20c9176ab8ef44ffb17eda5f41aca2a8. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:08:04.522390 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Getting quotas for user 9fe7f58143cd4ee2bc161e220fbbbd12 and project 20c9176ab8ef44ffb17eda5f41aca2a8. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:08:04.539271 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:08:04.541788 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:08:04.606709 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2b162a44-8d24-491d-a440-fb331994614b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.996911 Nov 24 16:08:04.612990 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 211/443] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:08:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 2000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:08:04.613840 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d2f0fc0c-0daa-44ce-a73d-6010ceba4391 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.266113 Nov 24 16:08:04.618430 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 233/444] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:04 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:04.630761 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-81216190-a1cb-46bf-a7c5-38c6d74a9cd5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:04.633007 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-81216190-a1cb-46bf-a7c5-38c6d74a9cd5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:04.778286 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-81216190-a1cb-46bf-a7c5-38c6d74a9cd5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:04.807828 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-81216190-a1cb-46bf-a7c5-38c6d74a9cd5 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1217 microversion: 2.1 time: 0.190684 Nov 24 16:08:04.828653 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 212/445] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:04 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1217 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:05.140968 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-60bf46ed-1335-4d7e-be51-f97dcd99be71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:05.143195 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-60bf46ed-1335-4d7e-be51-f97dcd99be71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:05.299061 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-60bf46ed-1335-4d7e-be51-f97dcd99be71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:05.299895 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-60bf46ed-1335-4d7e-be51-f97dcd99be71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:05.306381 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-60bf46ed-1335-4d7e-be51-f97dcd99be71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:05.310319 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-60bf46ed-1335-4d7e-be51-f97dcd99be71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:05.351705 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-75610335-e82d-45c6-a8d5-b898e992a468 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:05.354206 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-75610335-e82d-45c6-a8d5-b898e992a468 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:05.383846 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-75610335-e82d-45c6-a8d5-b898e992a468 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:05.386751 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-75610335-e82d-45c6-a8d5-b898e992a468 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:05.388846 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-75610335-e82d-45c6-a8d5-b898e992a468 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:05.392450 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-75610335-e82d-45c6-a8d5-b898e992a468 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:05.532451 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-75610335-e82d-45c6-a8d5-b898e992a468 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.185435 Nov 24 16:08:05.558131 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 213/446] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:05 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:05.645219 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f4f53bc9-e428-4d78-ae6d-15c1214b2e0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:05.653585 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f4f53bc9-e428-4d78-ae6d-15c1214b2e0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:05.698089 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f4f53bc9-e428-4d78-ae6d-15c1214b2e0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:05.700568 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f4f53bc9-e428-4d78-ae6d-15c1214b2e0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:05.704590 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f4f53bc9-e428-4d78-ae6d-15c1214b2e0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:05.707907 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f4f53bc9-e428-4d78-ae6d-15c1214b2e0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:05.817405 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-60bf46ed-1335-4d7e-be51-f97dcd99be71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:05.837553 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f4f53bc9-e428-4d78-ae6d-15c1214b2e0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.207928 Nov 24 16:08:05.838704 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-60bf46ed-1335-4d7e-be51-f97dcd99be71 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1567 microversion: 2.1 time: 0.702304 Nov 24 16:08:05.840008 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 214/447] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:05 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:05.854139 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fc4b1086-4911-472b-83db-29d95cd08840 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:05.855845 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fc4b1086-4911-472b-83db-29d95cd08840 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:05.869571 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 234/448] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:05 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1567 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:05.930463 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fc4b1086-4911-472b-83db-29d95cd08840 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:05.935330 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fc4b1086-4911-472b-83db-29d95cd08840 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:05.937722 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fc4b1086-4911-472b-83db-29d95cd08840 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:05.939924 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fc4b1086-4911-472b-83db-29d95cd08840 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:06.193364 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fc4b1086-4911-472b-83db-29d95cd08840 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:06.207093 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fc4b1086-4911-472b-83db-29d95cd08840 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1213 microversion: 2.1 time: 0.364502 Nov 24 16:08:06.208166 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 215/449] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:05 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1213 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:06.571846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-72e113be-36ff-4170-8492-7ed3a851eeea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:06.580331 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-72e113be-36ff-4170-8492-7ed3a851eeea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:06.606054 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-72e113be-36ff-4170-8492-7ed3a851eeea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:06.606681 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-72e113be-36ff-4170-8492-7ed3a851eeea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:06.607651 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-72e113be-36ff-4170-8492-7ed3a851eeea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:06.609354 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-72e113be-36ff-4170-8492-7ed3a851eeea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:06.744251 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-72e113be-36ff-4170-8492-7ed3a851eeea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.181735 Nov 24 16:08:06.745225 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 235/450] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:06 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:08:06.852217 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-077e872f-9d6f-4415-9f57-3cc4f3f516b3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:06.853141 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-077e872f-9d6f-4415-9f57-3cc4f3f516b3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:06.865644 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d75e4501-6b0b-498a-ba81-3b76c0d0b94f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:06.867100 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d75e4501-6b0b-498a-ba81-3b76c0d0b94f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:06.883651 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-077e872f-9d6f-4415-9f57-3cc4f3f516b3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:06.884107 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-077e872f-9d6f-4415-9f57-3cc4f3f516b3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:06.884933 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-077e872f-9d6f-4415-9f57-3cc4f3f516b3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:06.885437 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-077e872f-9d6f-4415-9f57-3cc4f3f516b3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:06.892992 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d75e4501-6b0b-498a-ba81-3b76c0d0b94f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:06.893845 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d75e4501-6b0b-498a-ba81-3b76c0d0b94f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:06.894938 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d75e4501-6b0b-498a-ba81-3b76c0d0b94f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:06.895620 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d75e4501-6b0b-498a-ba81-3b76c0d0b94f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:07.027505 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-077e872f-9d6f-4415-9f57-3cc4f3f516b3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.178777 Nov 24 16:08:07.036364 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 216/451] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:06 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:07.278805 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ef5aa6ed-32ef-427a-9543-2498d3edc7e0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:07.283197 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ef5aa6ed-32ef-427a-9543-2498d3edc7e0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:07.359652 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5aa6ed-32ef-427a-9543-2498d3edc7e0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:07.360716 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5aa6ed-32ef-427a-9543-2498d3edc7e0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:07.362973 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5aa6ed-32ef-427a-9543-2498d3edc7e0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:07.363287 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5aa6ed-32ef-427a-9543-2498d3edc7e0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:07.409762 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d75e4501-6b0b-498a-ba81-3b76c0d0b94f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:07.456830 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d75e4501-6b0b-498a-ba81-3b76c0d0b94f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1567 microversion: 2.1 time: 0.595572 Nov 24 16:08:07.464373 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 236/452] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:06 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1567 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:07.563984 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ef5aa6ed-32ef-427a-9543-2498d3edc7e0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:07.573327 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ef5aa6ed-32ef-427a-9543-2498d3edc7e0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1275 microversion: 2.1 time: 0.350481 Nov 24 16:08:07.575163 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 217/453] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:07 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1275 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:07.762247 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-92efc9e5-4dff-4e7d-8478-2d51f76b28f6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:07.768887 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-92efc9e5-4dff-4e7d-8478-2d51f76b28f6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:07.786323 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-92efc9e5-4dff-4e7d-8478-2d51f76b28f6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:07.786781 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-92efc9e5-4dff-4e7d-8478-2d51f76b28f6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:07.787600 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-92efc9e5-4dff-4e7d-8478-2d51f76b28f6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:07.797000 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-92efc9e5-4dff-4e7d-8478-2d51f76b28f6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:07.921669 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-92efc9e5-4dff-4e7d-8478-2d51f76b28f6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.168271 Nov 24 16:08:07.922853 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 237/454] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:07 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:08.050170 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-43ee8c76-3c60-47e6-8674-e1a0e0e229a5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:08.051746 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-43ee8c76-3c60-47e6-8674-e1a0e0e229a5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:08.060155 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-43ee8c76-3c60-47e6-8674-e1a0e0e229a5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:08.060869 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-43ee8c76-3c60-47e6-8674-e1a0e0e229a5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:08.063238 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-43ee8c76-3c60-47e6-8674-e1a0e0e229a5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:08.064135 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-43ee8c76-3c60-47e6-8674-e1a0e0e229a5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:08.150144 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-43ee8c76-3c60-47e6-8674-e1a0e0e229a5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.108235 Nov 24 16:08:08.151211 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 218/455] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:08 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:08.483873 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a3eb56e0-3430-4302-b641-9be676879ca2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:08.484660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a3eb56e0-3430-4302-b641-9be676879ca2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:08.507710 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a3eb56e0-3430-4302-b641-9be676879ca2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:08.510178 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a3eb56e0-3430-4302-b641-9be676879ca2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:08.511213 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a3eb56e0-3430-4302-b641-9be676879ca2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:08.512940 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a3eb56e0-3430-4302-b641-9be676879ca2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:08.593737 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e3506b8b-3b9e-426b-91a4-e24fce1d31aa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:08.594775 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e3506b8b-3b9e-426b-91a4-e24fce1d31aa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:08.618885 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e3506b8b-3b9e-426b-91a4-e24fce1d31aa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:08.619953 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e3506b8b-3b9e-426b-91a4-e24fce1d31aa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:08.621104 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e3506b8b-3b9e-426b-91a4-e24fce1d31aa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:08.621983 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e3506b8b-3b9e-426b-91a4-e24fce1d31aa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:08.804316 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a3eb56e0-3430-4302-b641-9be676879ca2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:08.843227 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a3eb56e0-3430-4302-b641-9be676879ca2 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1567 microversion: 2.1 time: 0.366873 Nov 24 16:08:08.844539 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 238/456] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:08 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1567 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:08.936251 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-074e7c85-fda5-41e8-9fbd-4d212446467f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:08.937090 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-074e7c85-fda5-41e8-9fbd-4d212446467f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:08.958398 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-074e7c85-fda5-41e8-9fbd-4d212446467f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:08.960116 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-074e7c85-fda5-41e8-9fbd-4d212446467f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:08.962653 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-074e7c85-fda5-41e8-9fbd-4d212446467f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:08.963293 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-074e7c85-fda5-41e8-9fbd-4d212446467f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:09.109127 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-074e7c85-fda5-41e8-9fbd-4d212446467f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.178454 Nov 24 16:08:09.110793 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 239/457] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:08 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:08:09.154879 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e3506b8b-3b9e-426b-91a4-e24fce1d31aa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:09.164897 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e3506b8b-3b9e-426b-91a4-e24fce1d31aa tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1317 microversion: 2.1 time: 0.576450 Nov 24 16:08:09.165154 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-43ad2c8e-4310-4628-90f9-0fb74d4dafd3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:09.166023 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-43ad2c8e-4310-4628-90f9-0fb74d4dafd3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:09.170376 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 219/458] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:08 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:09.204703 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-43ad2c8e-4310-4628-90f9-0fb74d4dafd3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:09.206885 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-43ad2c8e-4310-4628-90f9-0fb74d4dafd3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:09.210599 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-43ad2c8e-4310-4628-90f9-0fb74d4dafd3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:09.211500 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-43ad2c8e-4310-4628-90f9-0fb74d4dafd3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:09.353100 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-43ad2c8e-4310-4628-90f9-0fb74d4dafd3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.193946 Nov 24 16:08:09.355141 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 240/459] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:09 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:09.537423 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-0817ca3f-ede2-4f24-a726-6df42f50c0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67b8eee7-879b-4194-b4ff-e8bc9c576fd1", "tag": "a960049b-51b1-4158-8da6-316ecd0c7259"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:09.540658 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:08:09.540658 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:08:09.549962 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-0817ca3f-ede2-4f24-a726-6df42f50c0d0 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:09.550716 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-0817ca3f-ede2-4f24-a726-6df42f50c0d0 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:09.585146 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-0817ca3f-ede2-4f24-a726-6df42f50c0d0 service nova] Creating event network-changed:a960049b-51b1-4158-8da6-316ecd0c7259 for instance 67b8eee7-879b-4194-b4ff-e8bc9c576fd1 on hv-cinder-81899 Nov 24 16:08:09.602540 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-51df429b-a3bb-4fdd-b24f-504c8861dcb5 req-0817ca3f-ede2-4f24-a726-6df42f50c0d0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072921 Nov 24 16:08:09.603367 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 220/460] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:08:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:08:09.861509 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-15b9c10c-a633-426a-9ea9-3e70ee22ebd7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:09.862821 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-15b9c10c-a633-426a-9ea9-3e70ee22ebd7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:09.876382 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-15b9c10c-a633-426a-9ea9-3e70ee22ebd7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:09.883528 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-15b9c10c-a633-426a-9ea9-3e70ee22ebd7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:09.885487 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-15b9c10c-a633-426a-9ea9-3e70ee22ebd7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:09.886771 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-15b9c10c-a633-426a-9ea9-3e70ee22ebd7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:10.126421 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bf2a59f3-46a7-4b47-8ffd-2dd176f4d15b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:10.127853 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bf2a59f3-46a7-4b47-8ffd-2dd176f4d15b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:10.142534 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bf2a59f3-46a7-4b47-8ffd-2dd176f4d15b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:10.144266 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bf2a59f3-46a7-4b47-8ffd-2dd176f4d15b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:10.145117 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bf2a59f3-46a7-4b47-8ffd-2dd176f4d15b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:10.146821 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-15b9c10c-a633-426a-9ea9-3e70ee22ebd7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:10.149437 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bf2a59f3-46a7-4b47-8ffd-2dd176f4d15b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:10.168982 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-15b9c10c-a633-426a-9ea9-3e70ee22ebd7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1567 microversion: 2.1 time: 0.311449 Nov 24 16:08:10.173973 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 241/461] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:09 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1567 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:10.196018 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ce18b81e-89ed-4557-8160-8322be659d95 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:10.196884 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ce18b81e-89ed-4557-8160-8322be659d95 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:10.206693 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ce18b81e-89ed-4557-8160-8322be659d95 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:10.207405 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ce18b81e-89ed-4557-8160-8322be659d95 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:10.208425 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ce18b81e-89ed-4557-8160-8322be659d95 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:10.209096 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ce18b81e-89ed-4557-8160-8322be659d95 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:10.544704 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-ce18b81e-89ed-4557-8160-8322be659d95 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:10.559165 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ce18b81e-89ed-4557-8160-8322be659d95 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1317 microversion: 2.1 time: 0.368100 Nov 24 16:08:10.569091 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 242/462] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:10 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:10.573973 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6f79a6f9-49d0-4fdf-a693-416a324f1462 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:10.574974 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6f79a6f9-49d0-4fdf-a693-416a324f1462 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:10.584519 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6f79a6f9-49d0-4fdf-a693-416a324f1462 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:10.586531 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6f79a6f9-49d0-4fdf-a693-416a324f1462 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:10.587689 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6f79a6f9-49d0-4fdf-a693-416a324f1462 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:10.588280 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6f79a6f9-49d0-4fdf-a693-416a324f1462 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:10.677908 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bf2a59f3-46a7-4b47-8ffd-2dd176f4d15b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.557531 Nov 24 16:08:10.684102 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 221/463] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:10 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:10.717964 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6f79a6f9-49d0-4fdf-a693-416a324f1462 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.146833 Nov 24 16:08:10.732260 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 243/464] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:10 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:11.197321 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4a33752b-f29c-43bd-98f0-40a7204444a1 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:11.198541 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4a33752b-f29c-43bd-98f0-40a7204444a1 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:11.223771 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4a33752b-f29c-43bd-98f0-40a7204444a1 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:11.224742 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4a33752b-f29c-43bd-98f0-40a7204444a1 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:11.231560 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4a33752b-f29c-43bd-98f0-40a7204444a1 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:11.234077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4a33752b-f29c-43bd-98f0-40a7204444a1 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:11.514303 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4a33752b-f29c-43bd-98f0-40a7204444a1 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:11.529965 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4a33752b-f29c-43bd-98f0-40a7204444a1 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1567 microversion: 2.1 time: 0.340914 Nov 24 16:08:11.534820 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 222/465] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:11 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1567 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:11.578358 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8fff2f1d-6523-4549-bf73-30934b383328 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:11.580768 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8fff2f1d-6523-4549-bf73-30934b383328 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:11.595783 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8fff2f1d-6523-4549-bf73-30934b383328 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:11.596894 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8fff2f1d-6523-4549-bf73-30934b383328 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:11.599042 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8fff2f1d-6523-4549-bf73-30934b383328 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:11.600153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8fff2f1d-6523-4549-bf73-30934b383328 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:11.693297 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-477d55c7-a681-4687-9fbe-059f24aa7d5f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:11.696451 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-477d55c7-a681-4687-9fbe-059f24aa7d5f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:11.717002 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-477d55c7-a681-4687-9fbe-059f24aa7d5f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:11.717475 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-477d55c7-a681-4687-9fbe-059f24aa7d5f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:11.718949 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-477d55c7-a681-4687-9fbe-059f24aa7d5f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:11.719392 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-477d55c7-a681-4687-9fbe-059f24aa7d5f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:11.830178 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8fff2f1d-6523-4549-bf73-30934b383328 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:11.839088 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8fff2f1d-6523-4549-bf73-30934b383328 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1317 microversion: 2.1 time: 0.266562 Nov 24 16:08:11.842286 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 244/466] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:11 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:11.846492 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-94efd2c1-7217-4674-8cb6-626bf8ba2784 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:11.847396 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-94efd2c1-7217-4674-8cb6-626bf8ba2784 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:11.853718 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-94efd2c1-7217-4674-8cb6-626bf8ba2784 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:11.854148 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-94efd2c1-7217-4674-8cb6-626bf8ba2784 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:11.854930 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-94efd2c1-7217-4674-8cb6-626bf8ba2784 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:11.855355 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-94efd2c1-7217-4674-8cb6-626bf8ba2784 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:11.873648 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-477d55c7-a681-4687-9fbe-059f24aa7d5f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.185658 Nov 24 16:08:11.878370 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 223/467] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:11 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:11.923816 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-94efd2c1-7217-4674-8cb6-626bf8ba2784 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.081503 Nov 24 16:08:11.924470 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 245/468] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:11 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:12.560287 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f89707fe-bea2-4635-a49b-cb73f4bcff60 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:12.562013 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f89707fe-bea2-4635-a49b-cb73f4bcff60 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:12.585331 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f89707fe-bea2-4635-a49b-cb73f4bcff60 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:12.585331 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f89707fe-bea2-4635-a49b-cb73f4bcff60 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:12.585331 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f89707fe-bea2-4635-a49b-cb73f4bcff60 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:12.585331 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f89707fe-bea2-4635-a49b-cb73f4bcff60 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:12.856660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9c2eb60a-429a-4076-9ce6-a1b0f699d79f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:12.859693 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9c2eb60a-429a-4076-9ce6-a1b0f699d79f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:12.870011 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c2eb60a-429a-4076-9ce6-a1b0f699d79f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:12.870455 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c2eb60a-429a-4076-9ce6-a1b0f699d79f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:12.873356 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c2eb60a-429a-4076-9ce6-a1b0f699d79f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:12.874010 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c2eb60a-429a-4076-9ce6-a1b0f699d79f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:12.918417 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f89707fe-bea2-4635-a49b-cb73f4bcff60 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:12.927715 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f89707fe-bea2-4635-a49b-cb73f4bcff60 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1567 microversion: 2.1 time: 0.375718 Nov 24 16:08:12.929283 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 224/469] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:12 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1567 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:12.945314 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9a548df7-c427-4bc2-bedd-e68b454b557b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:12.946518 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9a548df7-c427-4bc2-bedd-e68b454b557b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:12.956400 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9a548df7-c427-4bc2-bedd-e68b454b557b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:12.957192 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9a548df7-c427-4bc2-bedd-e68b454b557b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:12.958454 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9a548df7-c427-4bc2-bedd-e68b454b557b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:12.959238 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9a548df7-c427-4bc2-bedd-e68b454b557b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:13.046010 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9c2eb60a-429a-4076-9ce6-a1b0f699d79f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:13.055628 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9c2eb60a-429a-4076-9ce6-a1b0f699d79f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1317 microversion: 2.1 time: 0.203133 Nov 24 16:08:13.056484 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 246/470] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:12 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:13.061664 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6ea434c5-629a-4c54-98e9-6cca904cebc9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:13.062558 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6ea434c5-629a-4c54-98e9-6cca904cebc9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:13.072333 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6ea434c5-629a-4c54-98e9-6cca904cebc9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:13.073134 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6ea434c5-629a-4c54-98e9-6cca904cebc9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:13.074081 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6ea434c5-629a-4c54-98e9-6cca904cebc9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:13.074662 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6ea434c5-629a-4c54-98e9-6cca904cebc9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:13.229602 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9a548df7-c427-4bc2-bedd-e68b454b557b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.298872 Nov 24 16:08:13.230612 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 225/471] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:12 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:13.238549 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6ea434c5-629a-4c54-98e9-6cca904cebc9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.180637 Nov 24 16:08:13.239192 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 247/472] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:13 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:13.965981 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-511bf9ed-1a2d-4f19-a715-a059346a0483 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:13.970229 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-511bf9ed-1a2d-4f19-a715-a059346a0483 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:13.994359 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-511bf9ed-1a2d-4f19-a715-a059346a0483 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:13.995215 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-511bf9ed-1a2d-4f19-a715-a059346a0483 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:13.999269 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-511bf9ed-1a2d-4f19-a715-a059346a0483 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:14.003199 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-511bf9ed-1a2d-4f19-a715-a059346a0483 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:14.086050 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6e7ece8d-0385-47cb-89b8-627a82870d56 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:14.087666 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6e7ece8d-0385-47cb-89b8-627a82870d56 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:14.104235 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6e7ece8d-0385-47cb-89b8-627a82870d56 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:14.104780 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6e7ece8d-0385-47cb-89b8-627a82870d56 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:14.105811 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6e7ece8d-0385-47cb-89b8-627a82870d56 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:14.106319 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6e7ece8d-0385-47cb-89b8-627a82870d56 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:14.265056 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-511bf9ed-1a2d-4f19-a715-a059346a0483 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:14.280946 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-511bf9ed-1a2d-4f19-a715-a059346a0483 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1567 microversion: 2.1 time: 0.337729 Nov 24 16:08:14.292749 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 226/473] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:13 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1567 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:14.294686 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-24c99d03-545f-4676-9774-9b52516b0027 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:14.295872 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-24c99d03-545f-4676-9774-9b52516b0027 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:14.305802 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24c99d03-545f-4676-9774-9b52516b0027 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:14.306631 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24c99d03-545f-4676-9774-9b52516b0027 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:14.307717 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24c99d03-545f-4676-9774-9b52516b0027 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:14.308387 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-24c99d03-545f-4676-9774-9b52516b0027 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:14.322394 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6e7ece8d-0385-47cb-89b8-627a82870d56 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:14.332223 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6e7ece8d-0385-47cb-89b8-627a82870d56 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1317 microversion: 2.1 time: 0.261606 Nov 24 16:08:14.332810 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 248/474] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:14 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:14.344775 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-097fbd8b-4bca-4f65-a0a5-98a0886f8ac0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:14.345774 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-097fbd8b-4bca-4f65-a0a5-98a0886f8ac0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:14.355099 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-097fbd8b-4bca-4f65-a0a5-98a0886f8ac0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:14.355554 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-097fbd8b-4bca-4f65-a0a5-98a0886f8ac0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:14.356359 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-097fbd8b-4bca-4f65-a0a5-98a0886f8ac0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:14.357264 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-097fbd8b-4bca-4f65-a0a5-98a0886f8ac0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:14.420593 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-24c99d03-545f-4676-9774-9b52516b0027 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.136604 Nov 24 16:08:14.421534 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 227/475] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:14 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:14.449857 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-097fbd8b-4bca-4f65-a0a5-98a0886f8ac0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.115744 Nov 24 16:08:14.455425 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 249/476] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:14 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:15.308200 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-97d01817-f0ce-4256-a0e3-4cadcbafd154 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:15.309226 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-97d01817-f0ce-4256-a0e3-4cadcbafd154 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:15.322513 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-97d01817-f0ce-4256-a0e3-4cadcbafd154 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:15.322964 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-97d01817-f0ce-4256-a0e3-4cadcbafd154 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:15.323754 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-97d01817-f0ce-4256-a0e3-4cadcbafd154 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:15.325161 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-97d01817-f0ce-4256-a0e3-4cadcbafd154 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:15.349636 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a887fa80-6cb0-4a74-9657-71eff8a63c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:15.351673 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a887fa80-6cb0-4a74-9657-71eff8a63c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:15.365369 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a887fa80-6cb0-4a74-9657-71eff8a63c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:15.366279 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a887fa80-6cb0-4a74-9657-71eff8a63c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:15.367385 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a887fa80-6cb0-4a74-9657-71eff8a63c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:15.368001 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a887fa80-6cb0-4a74-9657-71eff8a63c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:15.589581 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-97d01817-f0ce-4256-a0e3-4cadcbafd154 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:15.612140 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-97d01817-f0ce-4256-a0e3-4cadcbafd154 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1547 microversion: 2.1 time: 0.312890 Nov 24 16:08:15.613195 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 228/477] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:15 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1547 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:15.628076 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c759bfce-efa1-42c0-8706-796dd4dd86b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:15.632923 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c759bfce-efa1-42c0-8706-796dd4dd86b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:15.649564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c759bfce-efa1-42c0-8706-796dd4dd86b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:15.649823 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a887fa80-6cb0-4a74-9657-71eff8a63c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:15.650551 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c759bfce-efa1-42c0-8706-796dd4dd86b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:15.652326 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c759bfce-efa1-42c0-8706-796dd4dd86b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:15.658504 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a887fa80-6cb0-4a74-9657-71eff8a63c86 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1317 microversion: 2.1 time: 0.312711 Nov 24 16:08:15.658991 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c759bfce-efa1-42c0-8706-796dd4dd86b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:15.661814 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 250/478] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:15 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:15.687071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-21db9e50-0cf6-4696-b255-09483fc83a11 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:15.688109 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-21db9e50-0cf6-4696-b255-09483fc83a11 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:15.697920 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-21db9e50-0cf6-4696-b255-09483fc83a11 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:15.698567 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-21db9e50-0cf6-4696-b255-09483fc83a11 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:15.699532 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-21db9e50-0cf6-4696-b255-09483fc83a11 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:15.700116 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-21db9e50-0cf6-4696-b255-09483fc83a11 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:15.807121 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-21db9e50-0cf6-4696-b255-09483fc83a11 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.143758 Nov 24 16:08:15.807823 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 251/479] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:15 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:15.813761 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9c578a6a-be8f-4bb3-897e-c193705e0ffb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:15.815838 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9c578a6a-be8f-4bb3-897e-c193705e0ffb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:15.821106 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c759bfce-efa1-42c0-8706-796dd4dd86b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.205104 Nov 24 16:08:15.825538 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 229/480] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:15 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:15.829055 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c578a6a-be8f-4bb3-897e-c193705e0ffb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:15.829577 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c578a6a-be8f-4bb3-897e-c193705e0ffb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:15.830805 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c578a6a-be8f-4bb3-897e-c193705e0ffb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:15.831267 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c578a6a-be8f-4bb3-897e-c193705e0ffb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:15.978386 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-9c578a6a-be8f-4bb3-897e-c193705e0ffb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] HTTP exception thrown: Cannot 'detach_volume' instance a3a9b563-1f54-4c61-923f-9b557a3c307b while it is in vm_state rescued Nov 24 16:08:15.978990 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9c578a6a-be8f-4bb3-897e-c193705e0ffb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Returning 409 to user: Cannot 'detach_volume' instance a3a9b563-1f54-4c61-923f-9b557a3c307b while it is in vm_state rescued {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:08:15.979823 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9c578a6a-be8f-4bb3-897e-c193705e0ffb tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/os-volume_attachments/76ef1c99-a8d1-4a57-aede-2cc6c3fc7f58" status: 409 len: 152 microversion: 2.1 time: 0.170727 Nov 24 16:08:15.980380 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 252/481] 10.222.0.72 () {58 vars in 1415 bytes} [Wed Nov 24 16:08:15 2021] DELETE /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/os-volume_attachments/76ef1c99-a8d1-4a57-aede-2cc6c3fc7f58 => generated 152 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 24 16:08:15.990086 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d27d125c-d668-4055-bab0-6d44ee7d26b7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:15.991004 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d27d125c-d668-4055-bab0-6d44ee7d26b7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:15.998433 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d27d125c-d668-4055-bab0-6d44ee7d26b7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:15.999142 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d27d125c-d668-4055-bab0-6d44ee7d26b7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:16.000131 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d27d125c-d668-4055-bab0-6d44ee7d26b7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:16.000745 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d27d125c-d668-4055-bab0-6d44ee7d26b7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:16.092995 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d27d125c-d668-4055-bab0-6d44ee7d26b7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "POST /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/action" status: 202 len: 0 microversion: 2.1 time: 0.107595 Nov 24 16:08:16.099443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 230/482] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:15 2021] POST /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:08:16.117307 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-96a6a26b-552a-420f-a8a4-62c94ed654e9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:16.119048 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-96a6a26b-552a-420f-a8a4-62c94ed654e9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:16.146850 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-96a6a26b-552a-420f-a8a4-62c94ed654e9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:16.148977 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-96a6a26b-552a-420f-a8a4-62c94ed654e9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:16.150349 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-96a6a26b-552a-420f-a8a4-62c94ed654e9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:16.153993 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-96a6a26b-552a-420f-a8a4-62c94ed654e9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:16.353322 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-96a6a26b-552a-420f-a8a4-62c94ed654e9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:16.362431 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-96a6a26b-552a-420f-a8a4-62c94ed654e9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1555 microversion: 2.1 time: 0.260954 Nov 24 16:08:16.363608 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 253/483] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:16 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1555 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:16.646078 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-212a6bc4-e73e-4513-b8ed-6d7484afc61c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Action: 'create', calling method: .version_select at 0x7f361b303e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1115653760"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:16.667472 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-212a6bc4-e73e-4513-b8ed-6d7484afc61c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Getting quotas for project 3b09c1b1b2994015967d00aba299005b. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:08:16.673877 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-212a6bc4-e73e-4513-b8ed-6d7484afc61c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Getting quotas for user 4ccb8066ce5d49749aeef36b04e71942 and project 3b09c1b1b2994015967d00aba299005b. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:08:16.678727 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c9848d38-9551-41fa-ba8b-7fd342937b10 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:16.679338 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c9848d38-9551-41fa-ba8b-7fd342937b10 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:16.686157 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c9848d38-9551-41fa-ba8b-7fd342937b10 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:16.686602 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c9848d38-9551-41fa-ba8b-7fd342937b10 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:16.687389 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c9848d38-9551-41fa-ba8b-7fd342937b10 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:16.687865 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c9848d38-9551-41fa-ba8b-7fd342937b10 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:16.860594 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c9848d38-9551-41fa-ba8b-7fd342937b10 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:16.870226 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c9848d38-9551-41fa-ba8b-7fd342937b10 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1317 microversion: 2.1 time: 0.195583 Nov 24 16:08:16.871359 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 254/484] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:16 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:16.876632 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-04da9c67-50a4-427d-a937-6f138603eb6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:16.878048 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-04da9c67-50a4-427d-a937-6f138603eb6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:16.885731 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-04da9c67-50a4-427d-a937-6f138603eb6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:16.886454 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-04da9c67-50a4-427d-a937-6f138603eb6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:16.887790 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-04da9c67-50a4-427d-a937-6f138603eb6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:16.888380 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-04da9c67-50a4-427d-a937-6f138603eb6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:16.968269 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-04da9c67-50a4-427d-a937-6f138603eb6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.094998 Nov 24 16:08:16.969165 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 255/485] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:16 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:16.981584 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-551c8dba-0636-4492-abdf-1216d49d445b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:16.983042 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-551c8dba-0636-4492-abdf-1216d49d445b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:16.993455 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-551c8dba-0636-4492-abdf-1216d49d445b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:16.995052 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-551c8dba-0636-4492-abdf-1216d49d445b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:16.996543 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-551c8dba-0636-4492-abdf-1216d49d445b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:16.997210 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-551c8dba-0636-4492-abdf-1216d49d445b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:17.081400 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-551c8dba-0636-4492-abdf-1216d49d445b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.104614 Nov 24 16:08:17.092990 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 256/486] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:16 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:17.201319 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-212a6bc4-e73e-4513-b8ed-6d7484afc61c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Getting quotas for project 3b09c1b1b2994015967d00aba299005b. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:08:17.205684 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-212a6bc4-e73e-4513-b8ed-6d7484afc61c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Getting quotas for user 4ccb8066ce5d49749aeef36b04e71942 and project 3b09c1b1b2994015967d00aba299005b. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:08:17.231640 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-212a6bc4-e73e-4513-b8ed-6d7484afc61c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.590210 Nov 24 16:08:17.233187 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 231/487] 10.222.0.72 () {60 vars in 1157 bytes} [Wed Nov 24 16:08:16 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:17.348063 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1627801146", "imageRef": "a670a63e-e960-4d6c-a04d-ece34f3379de", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1115653760", "networks": [{"uuid": "5bfa1501-ec44-4dcf-b786-02db2672e4a7"}]}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:17.387177 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-598d765a-9f3d-44a8-b436-5b3fdb4735d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:17.388424 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-598d765a-9f3d-44a8-b436-5b3fdb4735d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:17.407628 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-598d765a-9f3d-44a8-b436-5b3fdb4735d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:17.408289 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-598d765a-9f3d-44a8-b436-5b3fdb4735d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:17.409689 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-598d765a-9f3d-44a8-b436-5b3fdb4735d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:17.410463 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-598d765a-9f3d-44a8-b436-5b3fdb4735d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:17.434713 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.network.neutron [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] validate_networks() for [('5bfa1501-ec44-4dcf-b786-02db2672e4a7', None, None, None, None, None)] {{(pid=116303) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:08:17.728689 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-598d765a-9f3d-44a8-b436-5b3fdb4735d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:17.737798 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-598d765a-9f3d-44a8-b436-5b3fdb4735d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1555 microversion: 2.1 time: 0.359936 Nov 24 16:08:17.739090 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 232/488] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:17 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1555 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:17.752556 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-51419e5e-f37c-40e0-b446-b0313f117f8f req-53c8c374-d06f-4bc2-8135-42fcad6ed6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b8eee7-879b-4194-b4ff-e8bc9c576fd1", "name": "network-vif-plugged", "status": "completed", "tag": "a960049b-51b1-4158-8da6-316ecd0c7259"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:17.754885 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:08:17.754885 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:08:17.766164 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-51419e5e-f37c-40e0-b446-b0313f117f8f req-53c8c374-d06f-4bc2-8135-42fcad6ed6da service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:17.766615 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-51419e5e-f37c-40e0-b446-b0313f117f8f req-53c8c374-d06f-4bc2-8135-42fcad6ed6da service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:17.781847 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-51419e5e-f37c-40e0-b446-b0313f117f8f req-53c8c374-d06f-4bc2-8135-42fcad6ed6da service nova] Creating event network-vif-plugged:a960049b-51b1-4158-8da6-316ecd0c7259 for instance 67b8eee7-879b-4194-b4ff-e8bc9c576fd1 on hv-cinder-81899 Nov 24 16:08:17.789254 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-51419e5e-f37c-40e0-b446-b0313f117f8f req-53c8c374-d06f-4bc2-8135-42fcad6ed6da service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047422 Nov 24 16:08:17.789898 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 233/489] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:08:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:08:17.889101 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cee1a8d2-3a08-4ab3-b040-15d2f0dae5c2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:17.889986 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cee1a8d2-3a08-4ab3-b040-15d2f0dae5c2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:17.897644 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cee1a8d2-3a08-4ab3-b040-15d2f0dae5c2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:17.898231 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cee1a8d2-3a08-4ab3-b040-15d2f0dae5c2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:17.899146 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cee1a8d2-3a08-4ab3-b040-15d2f0dae5c2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:17.899679 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cee1a8d2-3a08-4ab3-b040-15d2f0dae5c2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:17.933588 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Flavor limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:08:17.934617 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Image limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:08:17.935372 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Flavor pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:08:17.935810 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Image pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:08:17.936406 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:08:17.947417 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:17.947918 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:17.949782 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:17.950446 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:17.970063 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Getting quotas for project 3b09c1b1b2994015967d00aba299005b. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:08:17.975501 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Getting quotas for user 4ccb8066ce5d49749aeef36b04e71942 and project 3b09c1b1b2994015967d00aba299005b. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:08:17.988566 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Going to run 1 instances... {{(pid=116303) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:08:17.991555 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a670a63e-e960-4d6c-a04d-ece34f3379de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:08:18.039978 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6fcbac5b-b69f-4c47-b9cd-f08c1916b343 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700051 Nov 24 16:08:18.045630 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 257/490] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:08:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:08:18.050773 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-53794b68-c630-4859-8ac7-5c72eb25fac9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:18.052714 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-53794b68-c630-4859-8ac7-5c72eb25fac9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:18.061765 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-53794b68-c630-4859-8ac7-5c72eb25fac9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:18.062841 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-53794b68-c630-4859-8ac7-5c72eb25fac9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:18.064241 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-53794b68-c630-4859-8ac7-5c72eb25fac9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:18.064241 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-53794b68-c630-4859-8ac7-5c72eb25fac9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:18.082995 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cee1a8d2-3a08-4ab3-b040-15d2f0dae5c2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:18.096210 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cee1a8d2-3a08-4ab3-b040-15d2f0dae5c2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1317 microversion: 2.1 time: 0.211105 Nov 24 16:08:18.106310 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 234/491] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:17 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:18.111300 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0f5a3a79-49c8-4cb5-8951-2b89ae659230 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:18.111918 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0f5a3a79-49c8-4cb5-8951-2b89ae659230 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:18.143238 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-53794b68-c630-4859-8ac7-5c72eb25fac9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.100976 Nov 24 16:08:18.148285 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 258/492] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:18 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:18.153716 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-aab99823-bc65-463a-978e-3eec58867098 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:18.154770 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-aab99823-bc65-463a-978e-3eec58867098 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:18.161920 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aab99823-bc65-463a-978e-3eec58867098 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:18.162373 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aab99823-bc65-463a-978e-3eec58867098 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:18.163693 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aab99823-bc65-463a-978e-3eec58867098 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:18.164119 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aab99823-bc65-463a-978e-3eec58867098 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:18.172064 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0f5a3a79-49c8-4cb5-8951-2b89ae659230 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:18.179344 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0f5a3a79-49c8-4cb5-8951-2b89ae659230 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1259 microversion: 2.1 time: 0.071827 Nov 24 16:08:18.179989 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 235/493] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:18 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:18.477693 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-aab99823-bc65-463a-978e-3eec58867098 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.327806 Nov 24 16:08:18.479091 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 259/494] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:18 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:18.755835 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4abb0b51-7707-4738-bd5a-6892ff3ef46f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:18.757015 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4abb0b51-7707-4738-bd5a-6892ff3ef46f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:18.763173 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4abb0b51-7707-4738-bd5a-6892ff3ef46f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:18.763621 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4abb0b51-7707-4738-bd5a-6892ff3ef46f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:18.764404 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4abb0b51-7707-4738-bd5a-6892ff3ef46f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:18.764835 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4abb0b51-7707-4738-bd5a-6892ff3ef46f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:18.904829 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4abb0b51-7707-4738-bd5a-6892ff3ef46f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:18.913122 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4abb0b51-7707-4738-bd5a-6892ff3ef46f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1555 microversion: 2.1 time: 0.160434 Nov 24 16:08:18.913720 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 236/495] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:18 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:19.115343 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9c69179e-d826-4b20-9be3-cb23d65f8315 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:19.116227 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9c69179e-d826-4b20-9be3-cb23d65f8315 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:19.123946 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c69179e-d826-4b20-9be3-cb23d65f8315 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:19.124402 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c69179e-d826-4b20-9be3-cb23d65f8315 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:19.125267 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c69179e-d826-4b20-9be3-cb23d65f8315 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:19.125702 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c69179e-d826-4b20-9be3-cb23d65f8315 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:19.156737 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a557cdcc-9ceb-4100-93ce-b3cb5e81b61d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:19.157620 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a557cdcc-9ceb-4100-93ce-b3cb5e81b61d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:19.166125 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a557cdcc-9ceb-4100-93ce-b3cb5e81b61d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:19.166837 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a557cdcc-9ceb-4100-93ce-b3cb5e81b61d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:19.167501 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a557cdcc-9ceb-4100-93ce-b3cb5e81b61d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:19.167968 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a557cdcc-9ceb-4100-93ce-b3cb5e81b61d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:19.251352 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a557cdcc-9ceb-4100-93ce-b3cb5e81b61d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 28635 microversion: 2.1 time: 0.098675 Nov 24 16:08:19.252441 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 237/496] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:19 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 28635 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:19.261086 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c75c309d-0bfc-4508-88f4-99726448235a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:19.261894 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c75c309d-0bfc-4508-88f4-99726448235a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:19.269094 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c75c309d-0bfc-4508-88f4-99726448235a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:19.269892 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c75c309d-0bfc-4508-88f4-99726448235a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:19.270926 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c75c309d-0bfc-4508-88f4-99726448235a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:19.271555 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c75c309d-0bfc-4508-88f4-99726448235a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:19.310806 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9c69179e-d826-4b20-9be3-cb23d65f8315 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:19.320748 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9c69179e-d826-4b20-9be3-cb23d65f8315 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1317 microversion: 2.1 time: 0.209283 Nov 24 16:08:19.321415 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 260/497] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:19 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:19.378758 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c75c309d-0bfc-4508-88f4-99726448235a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:19.387927 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c75c309d-0bfc-4508-88f4-99726448235a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1329 microversion: 2.1 time: 0.133996 Nov 24 16:08:19.388499 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 238/498] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:19 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1329 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:19.489517 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5802c576-3b85-4ecd-9e0f-12785cb8dfff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:19.490526 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5802c576-3b85-4ecd-9e0f-12785cb8dfff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:19.498303 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5802c576-3b85-4ecd-9e0f-12785cb8dfff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:19.499111 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5802c576-3b85-4ecd-9e0f-12785cb8dfff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:19.500104 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5802c576-3b85-4ecd-9e0f-12785cb8dfff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:19.500574 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5802c576-3b85-4ecd-9e0f-12785cb8dfff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:19.583188 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5802c576-3b85-4ecd-9e0f-12785cb8dfff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 28623 microversion: 2.20 time: 0.097385 Nov 24 16:08:19.583989 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 261/499] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:19 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 28623 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:19.932548 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8def3e6a-68f4-446b-81e7-e27f883e034b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:19.933430 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8def3e6a-68f4-446b-81e7-e27f883e034b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:19.951475 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8def3e6a-68f4-446b-81e7-e27f883e034b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:19.954080 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8def3e6a-68f4-446b-81e7-e27f883e034b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:19.957532 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8def3e6a-68f4-446b-81e7-e27f883e034b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:19.960637 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8def3e6a-68f4-446b-81e7-e27f883e034b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:20.208120 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8def3e6a-68f4-446b-81e7-e27f883e034b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:20.229561 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8def3e6a-68f4-446b-81e7-e27f883e034b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1555 microversion: 2.1 time: 0.299423 Nov 24 16:08:20.239974 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 239/500] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:19 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1555 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:20.264682 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a653a855-0bca-4450-80de-6f38ee6ceddf tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:20.265933 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a653a855-0bca-4450-80de-6f38ee6ceddf tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:20.277238 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a653a855-0bca-4450-80de-6f38ee6ceddf tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:20.277681 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a653a855-0bca-4450-80de-6f38ee6ceddf tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:20.278489 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a653a855-0bca-4450-80de-6f38ee6ceddf tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:20.278919 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a653a855-0bca-4450-80de-6f38ee6ceddf tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:20.338214 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ea432f88-b737-460e-b417-f631917b9e17 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:20.339060 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ea432f88-b737-460e-b417-f631917b9e17 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:20.354402 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea432f88-b737-460e-b417-f631917b9e17 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:20.354885 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea432f88-b737-460e-b417-f631917b9e17 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:20.355695 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea432f88-b737-460e-b417-f631917b9e17 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:20.356138 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea432f88-b737-460e-b417-f631917b9e17 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:20.507512 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ea432f88-b737-460e-b417-f631917b9e17 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:20.515812 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ea432f88-b737-460e-b417-f631917b9e17 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1317 microversion: 2.1 time: 0.181371 Nov 24 16:08:20.526863 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 240/501] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:20 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:20.532396 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-40c0c5aa-116c-43f5-a0e3-811b548ad838 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:20.533009 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-40c0c5aa-116c-43f5-a0e3-811b548ad838 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:20.540089 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-40c0c5aa-116c-43f5-a0e3-811b548ad838 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:20.540709 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-40c0c5aa-116c-43f5-a0e3-811b548ad838 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:20.541789 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-40c0c5aa-116c-43f5-a0e3-811b548ad838 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:20.542228 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-40c0c5aa-116c-43f5-a0e3-811b548ad838 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:20.675890 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-40c0c5aa-116c-43f5-a0e3-811b548ad838 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:20.684775 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-40c0c5aa-116c-43f5-a0e3-811b548ad838 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1359 microversion: 2.1 time: 0.156720 Nov 24 16:08:20.685403 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 241/502] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:20 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:20.689843 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c27672a9-a098-4fb0-8522-b7c7aa74480a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:20.691010 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c27672a9-a098-4fb0-8522-b7c7aa74480a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:20.697949 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c27672a9-a098-4fb0-8522-b7c7aa74480a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:20.698405 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c27672a9-a098-4fb0-8522-b7c7aa74480a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:20.706246 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c27672a9-a098-4fb0-8522-b7c7aa74480a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:20.706887 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c27672a9-a098-4fb0-8522-b7c7aa74480a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:35.685618 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:08:35.686283 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: Wed Nov 24 16:08:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action (ip 10.222.0.72) !!! Nov 24 16:08:38.439255 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c27672a9-a098-4fb0-8522-b7c7aa74480a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 33165 microversion: 2.20 time: 17.752548 Nov 24 16:08:38.444199 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 242/503] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:20 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 33165 bytes in 17754 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:38.446514 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8e849562-00cb-4d56-9a93-878b31207f17 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:38.447277 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8e849562-00cb-4d56-9a93-878b31207f17 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:38.455396 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8e849562-00cb-4d56-9a93-878b31207f17 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:38.455995 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8e849562-00cb-4d56-9a93-878b31207f17 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:38.456644 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8e849562-00cb-4d56-9a93-878b31207f17 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:38.457198 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8e849562-00cb-4d56-9a93-878b31207f17 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:38.470033 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a653a855-0bca-4450-80de-6f38ee6ceddf tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 30562 microversion: 2.1 time: 18.209313 Nov 24 16:08:38.476961 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 262/504] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:20 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 30562 bytes in 18212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:38.481334 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-dcc0d14b-5f2c-4f33-b92a-4a5a09e1630e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:38.482352 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-dcc0d14b-5f2c-4f33-b92a-4a5a09e1630e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:38.491848 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dcc0d14b-5f2c-4f33-b92a-4a5a09e1630e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:38.492435 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dcc0d14b-5f2c-4f33-b92a-4a5a09e1630e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:38.493365 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dcc0d14b-5f2c-4f33-b92a-4a5a09e1630e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:38.493888 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dcc0d14b-5f2c-4f33-b92a-4a5a09e1630e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:38.645525 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-dcc0d14b-5f2c-4f33-b92a-4a5a09e1630e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:38.655295 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-dcc0d14b-5f2c-4f33-b92a-4a5a09e1630e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1317 microversion: 2.1 time: 0.180866 Nov 24 16:08:38.665647 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 263/505] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:38 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:38.673001 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b00d0a88-f89e-4beb-b19d-bf9d2db39ba5 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:38.673707 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b00d0a88-f89e-4beb-b19d-bf9d2db39ba5 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:38.682799 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b00d0a88-f89e-4beb-b19d-bf9d2db39ba5 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:38.683238 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b00d0a88-f89e-4beb-b19d-bf9d2db39ba5 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:38.684048 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b00d0a88-f89e-4beb-b19d-bf9d2db39ba5 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:38.684484 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b00d0a88-f89e-4beb-b19d-bf9d2db39ba5 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:38.835997 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8e849562-00cb-4d56-9a93-878b31207f17 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:38.844221 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8e849562-00cb-4d56-9a93-878b31207f17 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1555 microversion: 2.1 time: 0.402311 Nov 24 16:08:38.857484 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 243/506] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:38 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1555 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:38.865441 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b00d0a88-f89e-4beb-b19d-bf9d2db39ba5 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:38.882294 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b00d0a88-f89e-4beb-b19d-bf9d2db39ba5 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1359 microversion: 2.1 time: 0.214941 Nov 24 16:08:38.892693 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 264/507] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:38 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:39.200002 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-f8664155-8fdb-4d30-a3ee-864b3b8a149f req-b318efe5-9b6e-4730-b179-e710548c524f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:39.201640 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:08:39.201640 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:08:39.213276 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-f8664155-8fdb-4d30-a3ee-864b3b8a149f req-b318efe5-9b6e-4730-b179-e710548c524f service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:39.213752 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-f8664155-8fdb-4d30-a3ee-864b3b8a149f req-b318efe5-9b6e-4730-b179-e710548c524f service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:39.226457 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-f8664155-8fdb-4d30-a3ee-864b3b8a149f req-b318efe5-9b6e-4730-b179-e710548c524f service nova] Creating event network-changed:fe858985-c82e-488e-aceb-25ed4bffc8ee for instance 47f17e69-ba46-4a11-8bfb-01e444817ac1 on hv-cinder-81899 Nov 24 16:08:39.232851 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-f8664155-8fdb-4d30-a3ee-864b3b8a149f req-b318efe5-9b6e-4730-b179-e710548c524f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036170 Nov 24 16:08:39.233977 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 244/508] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:08:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:08:39.456318 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-df2cf7de-f911-45fa-b3ca-5ca7d36003cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:39.458295 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-df2cf7de-f911-45fa-b3ca-5ca7d36003cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:39.466214 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-df2cf7de-f911-45fa-b3ca-5ca7d36003cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:39.466751 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-df2cf7de-f911-45fa-b3ca-5ca7d36003cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:39.467608 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-df2cf7de-f911-45fa-b3ca-5ca7d36003cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:39.468046 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-df2cf7de-f911-45fa-b3ca-5ca7d36003cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:39.484649 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f1226e25-02de-48c5-809f-5072909c7723 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:39.486455 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f1226e25-02de-48c5-809f-5072909c7723 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:39.494062 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f1226e25-02de-48c5-809f-5072909c7723 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:39.494607 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f1226e25-02de-48c5-809f-5072909c7723 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:39.495494 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f1226e25-02de-48c5-809f-5072909c7723 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:39.496000 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f1226e25-02de-48c5-809f-5072909c7723 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:39.580793 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-df2cf7de-f911-45fa-b3ca-5ca7d36003cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 33383 microversion: 2.20 time: 0.131763 Nov 24 16:08:39.582631 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 265/509] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:39 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 33383 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:39.621895 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f1226e25-02de-48c5-809f-5072909c7723 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 32054 microversion: 2.1 time: 0.141153 Nov 24 16:08:39.625125 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 245/510] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:39 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 32054 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:08:39.673501 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-995f35d4-0b64-464b-adb2-9a2fee7a4ec3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:39.674335 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-995f35d4-0b64-464b-adb2-9a2fee7a4ec3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:39.683255 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-995f35d4-0b64-464b-adb2-9a2fee7a4ec3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:39.684076 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-995f35d4-0b64-464b-adb2-9a2fee7a4ec3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:39.685531 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-995f35d4-0b64-464b-adb2-9a2fee7a4ec3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:39.686276 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-995f35d4-0b64-464b-adb2-9a2fee7a4ec3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:39.844195 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-995f35d4-0b64-464b-adb2-9a2fee7a4ec3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:39.852373 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-995f35d4-0b64-464b-adb2-9a2fee7a4ec3 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1507 microversion: 2.1 time: 0.183082 Nov 24 16:08:39.852972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 266/511] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:39 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:39.862427 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7eb43037-f170-4931-887b-cf955c16c6d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:39.863245 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7eb43037-f170-4931-887b-cf955c16c6d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:39.875337 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7eb43037-f170-4931-887b-cf955c16c6d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:39.875997 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7eb43037-f170-4931-887b-cf955c16c6d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:39.877015 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7eb43037-f170-4931-887b-cf955c16c6d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:39.877486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7eb43037-f170-4931-887b-cf955c16c6d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:39.900263 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1bc8a621-344e-4889-ba1d-9d94f454aa31 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:39.901214 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1bc8a621-344e-4889-ba1d-9d94f454aa31 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:39.907662 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1bc8a621-344e-4889-ba1d-9d94f454aa31 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:39.908497 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1bc8a621-344e-4889-ba1d-9d94f454aa31 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:39.909854 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1bc8a621-344e-4889-ba1d-9d94f454aa31 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:39.910550 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1bc8a621-344e-4889-ba1d-9d94f454aa31 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:40.093958 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1bc8a621-344e-4889-ba1d-9d94f454aa31 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:40.102733 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1bc8a621-344e-4889-ba1d-9d94f454aa31 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1359 microversion: 2.1 time: 0.206833 Nov 24 16:08:40.103317 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 267/512] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:39 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:40.163633 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7eb43037-f170-4931-887b-cf955c16c6d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:40.198077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7eb43037-f170-4931-887b-cf955c16c6d3 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1561 microversion: 2.1 time: 0.339479 Nov 24 16:08:40.218954 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 246/513] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:39 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1561 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:40.298420 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c860a953-365d-45f4-940c-488c725bc3df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:40.298912 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c860a953-365d-45f4-940c-488c725bc3df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:40.305659 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c860a953-365d-45f4-940c-488c725bc3df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:40.306125 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c860a953-365d-45f4-940c-488c725bc3df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:40.306897 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c860a953-365d-45f4-940c-488c725bc3df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:40.307327 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c860a953-365d-45f4-940c-488c725bc3df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:40.401370 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.objects.instance [None req-c860a953-365d-45f4-940c-488c725bc3df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lazy-loading 'services' on Instance uuid a3a9b563-1f54-4c61-923f-9b557a3c307b {{(pid=116303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:08:40.539244 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c860a953-365d-45f4-940c-488c725bc3df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/os-volume_attachments/76ef1c99-a8d1-4a57-aede-2cc6c3fc7f58" status: 202 len: 0 microversion: 2.1 time: 0.244804 Nov 24 16:08:40.539942 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 268/514] 10.222.0.72 () {58 vars in 1415 bytes} [Wed Nov 24 16:08:40 2021] DELETE /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/os-volume_attachments/76ef1c99-a8d1-4a57-aede-2cc6c3fc7f58 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:40.548611 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dbdad969-ed3c-4f65-9131-2eb6f8918d3b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:40.549524 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dbdad969-ed3c-4f65-9131-2eb6f8918d3b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:40.558007 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbdad969-ed3c-4f65-9131-2eb6f8918d3b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:40.558462 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbdad969-ed3c-4f65-9131-2eb6f8918d3b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:40.559284 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbdad969-ed3c-4f65-9131-2eb6f8918d3b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:40.559723 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbdad969-ed3c-4f65-9131-2eb6f8918d3b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:40.594587 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dbdad969-ed3c-4f65-9131-2eb6f8918d3b tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049843 Nov 24 16:08:40.595679 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 247/515] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:08:40 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:08:40.597939 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e6464d50-44bf-41d1-84bb-c3491337a4c1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:40.599196 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e6464d50-44bf-41d1-84bb-c3491337a4c1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:40.605899 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e6464d50-44bf-41d1-84bb-c3491337a4c1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:40.606373 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e6464d50-44bf-41d1-84bb-c3491337a4c1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:40.607166 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e6464d50-44bf-41d1-84bb-c3491337a4c1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:40.607594 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e6464d50-44bf-41d1-84bb-c3491337a4c1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:40.635607 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b885aa41-57b4-4f21-863e-058b1046824a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:40.636553 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b885aa41-57b4-4f21-863e-058b1046824a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:40.643534 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b885aa41-57b4-4f21-863e-058b1046824a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:40.644243 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b885aa41-57b4-4f21-863e-058b1046824a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:40.645112 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b885aa41-57b4-4f21-863e-058b1046824a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:40.645550 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b885aa41-57b4-4f21-863e-058b1046824a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:40.798193 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b885aa41-57b4-4f21-863e-058b1046824a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 32748 microversion: 2.1 time: 0.166580 Nov 24 16:08:40.799381 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 248/516] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:40 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 32748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:08:40.819547 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e6464d50-44bf-41d1-84bb-c3491337a4c1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 33854 microversion: 2.20 time: 0.229361 Nov 24 16:08:40.820242 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 269/517] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:40 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 33854 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:41.120845 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b80d11f3-f78a-4184-ae8f-ac0acc180711 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:41.121580 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b80d11f3-f78a-4184-ae8f-ac0acc180711 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:41.129170 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b80d11f3-f78a-4184-ae8f-ac0acc180711 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:41.129626 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b80d11f3-f78a-4184-ae8f-ac0acc180711 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:41.130953 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b80d11f3-f78a-4184-ae8f-ac0acc180711 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:41.131668 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b80d11f3-f78a-4184-ae8f-ac0acc180711 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:41.295358 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b80d11f3-f78a-4184-ae8f-ac0acc180711 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:41.309163 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b80d11f3-f78a-4184-ae8f-ac0acc180711 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1359 microversion: 2.1 time: 0.192765 Nov 24 16:08:41.310016 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 249/518] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:41 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:41.365398 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5f8dec0e-9a7b-4bac-97b0-f615c4519ed4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bd861ad-5254-4177-aede-00b0afba4493"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:41.367295 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5f8dec0e-9a7b-4bac-97b0-f615c4519ed4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:41.375836 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f8dec0e-9a7b-4bac-97b0-f615c4519ed4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:41.376205 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f8dec0e-9a7b-4bac-97b0-f615c4519ed4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:41.377193 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f8dec0e-9a7b-4bac-97b0-f615c4519ed4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:41.377534 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f8dec0e-9a7b-4bac-97b0-f615c4519ed4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:41.607016 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2e254920-b1dc-437d-9281-e4630efe12df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:41.608393 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2e254920-b1dc-437d-9281-e4630efe12df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:41.617008 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e254920-b1dc-437d-9281-e4630efe12df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:41.617708 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e254920-b1dc-437d-9281-e4630efe12df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:41.619875 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e254920-b1dc-437d-9281-e4630efe12df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:41.620980 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e254920-b1dc-437d-9281-e4630efe12df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:41.660906 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5f8dec0e-9a7b-4bac-97b0-f615c4519ed4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "POST /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299981 Nov 24 16:08:41.662229 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 270/519] 10.222.0.72 () {60 vars in 1322 bytes} [Wed Nov 24 16:08:41 2021] POST /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:08:41.669194 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2e254920-b1dc-437d-9281-e4630efe12df tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064192 Nov 24 16:08:41.670140 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 250/520] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:08:41 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:08:41.813011 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fc14c290-ff2f-420c-b14d-af39b6e5ed86 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:41.813011 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fc14c290-ff2f-420c-b14d-af39b6e5ed86 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:41.825528 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fc14c290-ff2f-420c-b14d-af39b6e5ed86 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:41.826541 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fc14c290-ff2f-420c-b14d-af39b6e5ed86 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:41.828263 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fc14c290-ff2f-420c-b14d-af39b6e5ed86 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:41.829101 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fc14c290-ff2f-420c-b14d-af39b6e5ed86 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:41.831933 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9df66626-f360-4f5e-b8e3-7c6ec6eef0c1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:41.832892 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9df66626-f360-4f5e-b8e3-7c6ec6eef0c1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:41.839500 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9df66626-f360-4f5e-b8e3-7c6ec6eef0c1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:41.839941 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9df66626-f360-4f5e-b8e3-7c6ec6eef0c1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:41.840795 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9df66626-f360-4f5e-b8e3-7c6ec6eef0c1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:41.841457 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9df66626-f360-4f5e-b8e3-7c6ec6eef0c1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:41.928280 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fc14c290-ff2f-420c-b14d-af39b6e5ed86 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 33372 microversion: 2.1 time: 0.119133 Nov 24 16:08:41.929077 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 271/521] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:41 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 33372 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:41.966255 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9df66626-f360-4f5e-b8e3-7c6ec6eef0c1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 34447 microversion: 2.20 time: 0.137964 Nov 24 16:08:41.967136 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 251/522] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:41 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 34447 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:08:42.328570 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2826e16d-a502-4e26-9c6b-535488f2ef62 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:42.329312 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2826e16d-a502-4e26-9c6b-535488f2ef62 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:42.339726 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2826e16d-a502-4e26-9c6b-535488f2ef62 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:42.340178 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2826e16d-a502-4e26-9c6b-535488f2ef62 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:42.341012 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2826e16d-a502-4e26-9c6b-535488f2ef62 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:42.341555 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2826e16d-a502-4e26-9c6b-535488f2ef62 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:42.511790 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-2826e16d-a502-4e26-9c6b-535488f2ef62 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:42.520103 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2826e16d-a502-4e26-9c6b-535488f2ef62 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1359 microversion: 2.1 time: 0.195503 Nov 24 16:08:42.520716 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 272/523] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:42 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:42.682203 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6d60e0e2-c52c-4ce9-b908-15f2f9ceb1d6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:42.683190 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6d60e0e2-c52c-4ce9-b908-15f2f9ceb1d6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:42.690591 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6d60e0e2-c52c-4ce9-b908-15f2f9ceb1d6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:42.691046 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6d60e0e2-c52c-4ce9-b908-15f2f9ceb1d6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:42.691851 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6d60e0e2-c52c-4ce9-b908-15f2f9ceb1d6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:42.692289 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6d60e0e2-c52c-4ce9-b908-15f2f9ceb1d6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:42.727437 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6d60e0e2-c52c-4ce9-b908-15f2f9ceb1d6 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049487 Nov 24 16:08:42.728027 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 252/524] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:08:42 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:08:42.940496 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-90540d73-8470-42ec-9513-00e6a1c06c56 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:42.941603 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-90540d73-8470-42ec-9513-00e6a1c06c56 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:42.949300 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-90540d73-8470-42ec-9513-00e6a1c06c56 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:42.949749 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-90540d73-8470-42ec-9513-00e6a1c06c56 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:42.950548 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-90540d73-8470-42ec-9513-00e6a1c06c56 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:42.950983 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-90540d73-8470-42ec-9513-00e6a1c06c56 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:42.979508 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4ccda061-e5af-426e-a362-3f262a442853 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:42.980440 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4ccda061-e5af-426e-a362-3f262a442853 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:42.988811 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ccda061-e5af-426e-a362-3f262a442853 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:42.990052 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ccda061-e5af-426e-a362-3f262a442853 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:42.992042 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ccda061-e5af-426e-a362-3f262a442853 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:42.992538 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ccda061-e5af-426e-a362-3f262a442853 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:43.113071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-90540d73-8470-42ec-9513-00e6a1c06c56 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 34142 microversion: 2.1 time: 0.176107 Nov 24 16:08:43.113750 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 273/525] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:42 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 34142 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:43.148088 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4ccda061-e5af-426e-a362-3f262a442853 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 34998 microversion: 2.20 time: 0.172741 Nov 24 16:08:43.149006 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 253/526] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:42 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 34998 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:08:43.542303 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f4532076-d370-4d1a-bdea-8b726fdda125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:43.543581 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f4532076-d370-4d1a-bdea-8b726fdda125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:43.557354 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f4532076-d370-4d1a-bdea-8b726fdda125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:43.558169 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f4532076-d370-4d1a-bdea-8b726fdda125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:43.559676 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f4532076-d370-4d1a-bdea-8b726fdda125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:43.560494 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f4532076-d370-4d1a-bdea-8b726fdda125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:43.745801 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-f4532076-d370-4d1a-bdea-8b726fdda125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:43.754746 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f4532076-d370-4d1a-bdea-8b726fdda125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1359 microversion: 2.1 time: 0.219363 Nov 24 16:08:43.755425 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 274/527] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:43 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:44.126541 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-15c87c1f-466b-4b8c-a7ac-a120fd49c46b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:44.127585 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-15c87c1f-466b-4b8c-a7ac-a120fd49c46b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:44.135637 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-15c87c1f-466b-4b8c-a7ac-a120fd49c46b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:44.136085 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-15c87c1f-466b-4b8c-a7ac-a120fd49c46b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:44.136896 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-15c87c1f-466b-4b8c-a7ac-a120fd49c46b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:44.137378 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-15c87c1f-466b-4b8c-a7ac-a120fd49c46b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:44.160743 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f40df5c5-ff80-46c3-8220-2f34d23402b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:44.162424 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f40df5c5-ff80-46c3-8220-2f34d23402b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:44.168764 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f40df5c5-ff80-46c3-8220-2f34d23402b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:44.169269 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f40df5c5-ff80-46c3-8220-2f34d23402b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:44.170068 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f40df5c5-ff80-46c3-8220-2f34d23402b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:44.170493 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f40df5c5-ff80-46c3-8220-2f34d23402b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:44.271268 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-15c87c1f-466b-4b8c-a7ac-a120fd49c46b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 34500 microversion: 2.1 time: 0.148286 Nov 24 16:08:44.272165 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 254/528] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:44 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 34500 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:44.285070 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f40df5c5-ff80-46c3-8220-2f34d23402b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 35699 microversion: 2.20 time: 0.128790 Nov 24 16:08:44.285732 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 275/529] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:44 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 35699 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:08:44.772946 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-069066ed-8f7e-44b5-9536-2f4c235ffeae tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:44.774067 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-069066ed-8f7e-44b5-9536-2f4c235ffeae tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:44.782025 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-069066ed-8f7e-44b5-9536-2f4c235ffeae tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:44.782620 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-069066ed-8f7e-44b5-9536-2f4c235ffeae tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:44.783659 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-069066ed-8f7e-44b5-9536-2f4c235ffeae tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:44.784262 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-069066ed-8f7e-44b5-9536-2f4c235ffeae tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:44.946613 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-069066ed-8f7e-44b5-9536-2f4c235ffeae tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:44.959929 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-069066ed-8f7e-44b5-9536-2f4c235ffeae tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1359 microversion: 2.1 time: 0.191144 Nov 24 16:08:44.960671 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 255/530] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:44 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:45.127120 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d1488326-16d6-47bc-a366-cde846640a63 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:45.127719 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d1488326-16d6-47bc-a366-cde846640a63 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:45.136105 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d1488326-16d6-47bc-a366-cde846640a63 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:45.136556 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d1488326-16d6-47bc-a366-cde846640a63 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:45.137418 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d1488326-16d6-47bc-a366-cde846640a63 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:45.137861 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d1488326-16d6-47bc-a366-cde846640a63 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:45.168494 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d1488326-16d6-47bc-a366-cde846640a63 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Going to try to terminate instance {{(pid=116303) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:08:45.265385 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d1488326-16d6-47bc-a366-cde846640a63 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "DELETE /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 204 len: 0 microversion: 2.1 time: 0.141995 Nov 24 16:08:45.266237 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 276/531] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:08:45 2021] DELETE /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 16:08:45.277147 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d9a80c19-b06a-4036-a6fc-e3bfc926c59a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:45.278000 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d9a80c19-b06a-4036-a6fc-e3bfc926c59a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:45.286452 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d9a80c19-b06a-4036-a6fc-e3bfc926c59a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:45.286790 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-640a0f46-bcc9-4002-8f23-4073a0a0c914 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:45.287008 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d9a80c19-b06a-4036-a6fc-e3bfc926c59a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:45.288074 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d9a80c19-b06a-4036-a6fc-e3bfc926c59a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:45.288262 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-640a0f46-bcc9-4002-8f23-4073a0a0c914 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:45.288427 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d9a80c19-b06a-4036-a6fc-e3bfc926c59a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:45.299326 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-640a0f46-bcc9-4002-8f23-4073a0a0c914 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:45.299989 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-640a0f46-bcc9-4002-8f23-4073a0a0c914 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:45.301623 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-640a0f46-bcc9-4002-8f23-4073a0a0c914 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:45.302989 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-640a0f46-bcc9-4002-8f23-4073a0a0c914 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:45.447805 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-640a0f46-bcc9-4002-8f23-4073a0a0c914 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 34917 microversion: 2.1 time: 0.165619 Nov 24 16:08:45.449049 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 277/532] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:45 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 34917 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:45.456542 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d9a80c19-b06a-4036-a6fc-e3bfc926c59a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:45.463445 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-aa8c79e9-541c-40dd-9cfc-083eb3983be4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:45.465375 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-aa8c79e9-541c-40dd-9cfc-083eb3983be4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:45.473101 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d9a80c19-b06a-4036-a6fc-e3bfc926c59a tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1508 microversion: 2.1 time: 0.200202 Nov 24 16:08:45.475661 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 256/533] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:45 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:45.481851 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aa8c79e9-541c-40dd-9cfc-083eb3983be4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:45.482297 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aa8c79e9-541c-40dd-9cfc-083eb3983be4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:45.483097 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aa8c79e9-541c-40dd-9cfc-083eb3983be4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:45.483523 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aa8c79e9-541c-40dd-9cfc-083eb3983be4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:45.601370 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-aa8c79e9-541c-40dd-9cfc-083eb3983be4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 36705 microversion: 2.20 time: 0.146171 Nov 24 16:08:45.602561 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 278/534] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:45 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 36705 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:45.982069 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d862b087-0f45-452f-8fb7-1e0332b07a4d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:45.983329 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d862b087-0f45-452f-8fb7-1e0332b07a4d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:45.998065 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d862b087-0f45-452f-8fb7-1e0332b07a4d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:45.998734 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d862b087-0f45-452f-8fb7-1e0332b07a4d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:46.001456 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d862b087-0f45-452f-8fb7-1e0332b07a4d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:46.002620 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d862b087-0f45-452f-8fb7-1e0332b07a4d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:46.160394 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d862b087-0f45-452f-8fb7-1e0332b07a4d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:46.170523 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d862b087-0f45-452f-8fb7-1e0332b07a4d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1359 microversion: 2.1 time: 0.195415 Nov 24 16:08:46.171124 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 257/535] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:45 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:46.462974 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7b4b0f0a-ee30-426a-b3b5-0e24848964bb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:46.463999 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7b4b0f0a-ee30-426a-b3b5-0e24848964bb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:46.472214 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7b4b0f0a-ee30-426a-b3b5-0e24848964bb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:46.472528 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7b4b0f0a-ee30-426a-b3b5-0e24848964bb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:46.473377 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7b4b0f0a-ee30-426a-b3b5-0e24848964bb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:46.473844 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7b4b0f0a-ee30-426a-b3b5-0e24848964bb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:46.505934 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4c695a16-14ac-4822-8f76-ff930f311ea9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:46.507238 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4c695a16-14ac-4822-8f76-ff930f311ea9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:46.515476 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4c695a16-14ac-4822-8f76-ff930f311ea9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:46.516110 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4c695a16-14ac-4822-8f76-ff930f311ea9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:46.517340 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4c695a16-14ac-4822-8f76-ff930f311ea9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:46.518330 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4c695a16-14ac-4822-8f76-ff930f311ea9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:46.682395 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4c695a16-14ac-4822-8f76-ff930f311ea9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:46.693319 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4c695a16-14ac-4822-8f76-ff930f311ea9 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1508 microversion: 2.1 time: 0.195863 Nov 24 16:08:46.693915 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 258/536] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:46 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:46.698863 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b3106c29-ea59-468c-8d75-0f06c1c448c9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:46.699557 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7b4b0f0a-ee30-426a-b3b5-0e24848964bb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 35484 microversion: 2.1 time: 0.242545 Nov 24 16:08:46.699892 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b3106c29-ea59-468c-8d75-0f06c1c448c9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:46.707144 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b3106c29-ea59-468c-8d75-0f06c1c448c9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:46.707590 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b3106c29-ea59-468c-8d75-0f06c1c448c9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:46.708474 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 279/537] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:46 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 35484 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:46.709121 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b3106c29-ea59-468c-8d75-0f06c1c448c9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:46.709732 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b3106c29-ea59-468c-8d75-0f06c1c448c9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:46.824185 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b3106c29-ea59-468c-8d75-0f06c1c448c9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 37342 microversion: 2.20 time: 0.128205 Nov 24 16:08:46.831271 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 259/538] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:46 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 37342 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:47.192337 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-256b920a-14a7-423d-a50c-dc0c303c56b0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:47.193105 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-256b920a-14a7-423d-a50c-dc0c303c56b0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:47.200352 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-256b920a-14a7-423d-a50c-dc0c303c56b0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:47.200794 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-256b920a-14a7-423d-a50c-dc0c303c56b0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:47.201628 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-256b920a-14a7-423d-a50c-dc0c303c56b0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:47.202058 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-256b920a-14a7-423d-a50c-dc0c303c56b0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:47.350379 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-256b920a-14a7-423d-a50c-dc0c303c56b0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:47.358210 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-256b920a-14a7-423d-a50c-dc0c303c56b0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1359 microversion: 2.1 time: 0.169970 Nov 24 16:08:47.358801 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 280/539] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:47 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:47.713465 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ceba94de-d2f4-494a-bd8e-902a2ee69191 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:47.714184 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ceba94de-d2f4-494a-bd8e-902a2ee69191 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:47.715280 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5f1b1d6e-4546-43e5-8445-85994c3547ce tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:47.716213 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5f1b1d6e-4546-43e5-8445-85994c3547ce tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:47.722259 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ceba94de-d2f4-494a-bd8e-902a2ee69191 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:47.722707 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ceba94de-d2f4-494a-bd8e-902a2ee69191 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:47.723165 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f1b1d6e-4546-43e5-8445-85994c3547ce tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:47.723523 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ceba94de-d2f4-494a-bd8e-902a2ee69191 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:47.723690 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f1b1d6e-4546-43e5-8445-85994c3547ce tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:47.723984 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ceba94de-d2f4-494a-bd8e-902a2ee69191 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:47.724821 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f1b1d6e-4546-43e5-8445-85994c3547ce tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:47.725378 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f1b1d6e-4546-43e5-8445-85994c3547ce tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:47.881232 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ceba94de-d2f4-494a-bd8e-902a2ee69191 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:47.883707 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5f1b1d6e-4546-43e5-8445-85994c3547ce tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 35978 microversion: 2.1 time: 0.171965 Nov 24 16:08:47.890300 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 281/540] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:47 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 35978 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:08:47.890300 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d5c277db-5b43-41af-a9ce-9d2c4178c795 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:47.890725 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ceba94de-d2f4-494a-bd8e-902a2ee69191 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1508 microversion: 2.1 time: 0.181495 Nov 24 16:08:47.890933 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 260/541] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:47 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:47.891091 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d5c277db-5b43-41af-a9ce-9d2c4178c795 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:47.900083 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d5c277db-5b43-41af-a9ce-9d2c4178c795 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:47.900526 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d5c277db-5b43-41af-a9ce-9d2c4178c795 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:47.901470 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d5c277db-5b43-41af-a9ce-9d2c4178c795 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:47.901902 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d5c277db-5b43-41af-a9ce-9d2c4178c795 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:48.016833 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d5c277db-5b43-41af-a9ce-9d2c4178c795 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 37834 microversion: 2.20 time: 0.130921 Nov 24 16:08:48.017504 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 282/542] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:47 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 37834 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:48.375813 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b38c9b82-3f4c-46a7-89e1-9e17864c9ef9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:48.376307 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b38c9b82-3f4c-46a7-89e1-9e17864c9ef9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:48.383333 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b38c9b82-3f4c-46a7-89e1-9e17864c9ef9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:48.383781 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b38c9b82-3f4c-46a7-89e1-9e17864c9ef9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:48.384585 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b38c9b82-3f4c-46a7-89e1-9e17864c9ef9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:48.385021 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b38c9b82-3f4c-46a7-89e1-9e17864c9ef9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:48.562705 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b38c9b82-3f4c-46a7-89e1-9e17864c9ef9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:48.571762 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b38c9b82-3f4c-46a7-89e1-9e17864c9ef9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1359 microversion: 2.1 time: 0.199898 Nov 24 16:08:48.572385 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 261/543] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:48 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:48.899534 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0ffefa3f-2a12-49ac-bf3c-4e718cf1046a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:48.900431 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0ffefa3f-2a12-49ac-bf3c-4e718cf1046a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:48.908211 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0ffefa3f-2a12-49ac-bf3c-4e718cf1046a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:48.908648 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0ffefa3f-2a12-49ac-bf3c-4e718cf1046a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:48.909312 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3b276ac2-5a0c-4ca3-84ec-a9ceed8fa153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:48.909984 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0ffefa3f-2a12-49ac-bf3c-4e718cf1046a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:48.909984 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0ffefa3f-2a12-49ac-bf3c-4e718cf1046a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:48.910315 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3b276ac2-5a0c-4ca3-84ec-a9ceed8fa153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:48.918101 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3b276ac2-5a0c-4ca3-84ec-a9ceed8fa153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:48.918659 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3b276ac2-5a0c-4ca3-84ec-a9ceed8fa153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:48.919631 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3b276ac2-5a0c-4ca3-84ec-a9ceed8fa153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:48.920117 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3b276ac2-5a0c-4ca3-84ec-a9ceed8fa153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:49.028056 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0ffefa3f-2a12-49ac-bf3c-4e718cf1046a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 36374 microversion: 2.1 time: 0.132671 Nov 24 16:08:49.028727 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 283/544] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:48 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 36374 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:49.034724 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-52f24cc1-761e-4e99-9578-16f3f3c5db4f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:49.035739 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-52f24cc1-761e-4e99-9578-16f3f3c5db4f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:49.043306 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-52f24cc1-761e-4e99-9578-16f3f3c5db4f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:49.043751 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-52f24cc1-761e-4e99-9578-16f3f3c5db4f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:49.044568 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-52f24cc1-761e-4e99-9578-16f3f3c5db4f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:49.045010 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-52f24cc1-761e-4e99-9578-16f3f3c5db4f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:49.080674 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3b276ac2-5a0c-4ca3-84ec-a9ceed8fa153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:49.095089 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3b276ac2-5a0c-4ca3-84ec-a9ceed8fa153 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1508 microversion: 2.1 time: 0.189619 Nov 24 16:08:49.098013 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 262/545] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:48 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:49.151673 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-52f24cc1-761e-4e99-9578-16f3f3c5db4f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 38124 microversion: 2.20 time: 0.120884 Nov 24 16:08:49.154643 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 284/546] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:49 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 38124 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:08:49.591032 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c5b48e19-33d7-45c9-9fe2-f0ee90d38a2d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:49.591767 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c5b48e19-33d7-45c9-9fe2-f0ee90d38a2d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:49.597934 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5b48e19-33d7-45c9-9fe2-f0ee90d38a2d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:49.598383 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5b48e19-33d7-45c9-9fe2-f0ee90d38a2d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:49.600026 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5b48e19-33d7-45c9-9fe2-f0ee90d38a2d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:49.600480 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5b48e19-33d7-45c9-9fe2-f0ee90d38a2d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:49.759517 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c5b48e19-33d7-45c9-9fe2-f0ee90d38a2d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:49.767752 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c5b48e19-33d7-45c9-9fe2-f0ee90d38a2d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1359 microversion: 2.1 time: 0.181098 Nov 24 16:08:49.768354 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 263/547] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:49 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:49.899732 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-b97202ea-861c-43de-9711-2c7ba7db229c req-b7785a14-7cf8-48f1-a48d-811aaa9034de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "name": "network-vif-plugged", "status": "completed", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:49.901429 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:08:49.901429 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:08:49.909792 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-b97202ea-861c-43de-9711-2c7ba7db229c req-b7785a14-7cf8-48f1-a48d-811aaa9034de service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:49.910508 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-b97202ea-861c-43de-9711-2c7ba7db229c req-b7785a14-7cf8-48f1-a48d-811aaa9034de service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:49.924250 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-b97202ea-861c-43de-9711-2c7ba7db229c req-b7785a14-7cf8-48f1-a48d-811aaa9034de service nova] Creating event network-vif-plugged:fe858985-c82e-488e-aceb-25ed4bffc8ee for instance 47f17e69-ba46-4a11-8bfb-01e444817ac1 on hv-cinder-81899 Nov 24 16:08:49.930505 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-b97202ea-861c-43de-9711-2c7ba7db229c req-b7785a14-7cf8-48f1-a48d-811aaa9034de service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036717 Nov 24 16:08:49.931262 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 285/548] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:08:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:08:50.040863 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-29692449-e98d-43cb-8e73-eaece4f28925 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:50.042746 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-29692449-e98d-43cb-8e73-eaece4f28925 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:50.048720 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-29692449-e98d-43cb-8e73-eaece4f28925 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.049214 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-29692449-e98d-43cb-8e73-eaece4f28925 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:50.050089 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-29692449-e98d-43cb-8e73-eaece4f28925 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.050514 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-29692449-e98d-43cb-8e73-eaece4f28925 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:50.115689 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-dcbe850d-ae18-427f-b900-8589b55e2a24 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:50.119896 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-dcbe850d-ae18-427f-b900-8589b55e2a24 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:50.124430 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dcbe850d-ae18-427f-b900-8589b55e2a24 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.125977 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dcbe850d-ae18-427f-b900-8589b55e2a24 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:50.126926 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dcbe850d-ae18-427f-b900-8589b55e2a24 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.129168 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dcbe850d-ae18-427f-b900-8589b55e2a24 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:50.139596 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-29692449-e98d-43cb-8e73-eaece4f28925 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 37167 microversion: 2.1 time: 0.102810 Nov 24 16:08:50.144998 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 264/549] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:50 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 37167 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:50.190842 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-71e0c078-7670-4572-8d84-9ee091a40a18 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:50.206440 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-71e0c078-7670-4572-8d84-9ee091a40a18 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:50.229338 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-71e0c078-7670-4572-8d84-9ee091a40a18 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.231262 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-71e0c078-7670-4572-8d84-9ee091a40a18 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:50.232478 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-71e0c078-7670-4572-8d84-9ee091a40a18 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.233807 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-71e0c078-7670-4572-8d84-9ee091a40a18 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:50.318987 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-dcbe850d-ae18-427f-b900-8589b55e2a24 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:50.331507 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-dcbe850d-ae18-427f-b900-8589b55e2a24 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1508 microversion: 2.1 time: 0.221000 Nov 24 16:08:50.343263 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 286/550] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:50 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:50.360528 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-71e0c078-7670-4572-8d84-9ee091a40a18 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 200 len: 38266 microversion: 2.20 time: 0.197247 Nov 24 16:08:50.361228 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 265/551] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:50 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 38266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:08:50.383445 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-30a5bd45-f98b-4038-8b55-0b2588d28b8e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:50.383950 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-30a5bd45-f98b-4038-8b55-0b2588d28b8e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:50.391747 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-30a5bd45-f98b-4038-8b55-0b2588d28b8e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.392911 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-30a5bd45-f98b-4038-8b55-0b2588d28b8e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:50.393981 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-30a5bd45-f98b-4038-8b55-0b2588d28b8e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.394423 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-30a5bd45-f98b-4038-8b55-0b2588d28b8e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:50.428572 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-30a5bd45-f98b-4038-8b55-0b2588d28b8e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/ips" status: 200 len: 151 microversion: 2.20 time: 0.050858 Nov 24 16:08:50.429660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 287/552] 10.222.0.72 () {60 vars in 1288 bytes} [Wed Nov 24 16:08:50 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/ips => generated 151 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:08:50.488706 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-e26ecf66-9b8d-4d4d-9c98-40b28383e89a req-0c863d04-c76d-45c2-8d06-ba5d221e767f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f50ef3-7864-4548-8230-12ddb5ef83a0", "name": "network-vif-deleted", "tag": "a424f220-1812-4f50-ab01-68a1923ec96d"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:50.492837 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:08:50.492837 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:08:50.521675 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fcc2c539-b877-441f-9cf5-3527f93808ff tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:50.522597 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fcc2c539-b877-441f-9cf5-3527f93808ff tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:50.534426 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fcc2c539-b877-441f-9cf5-3527f93808ff tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.535725 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fcc2c539-b877-441f-9cf5-3527f93808ff tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:50.536915 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-e26ecf66-9b8d-4d4d-9c98-40b28383e89a req-0c863d04-c76d-45c2-8d06-ba5d221e767f service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.537677 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-e26ecf66-9b8d-4d4d-9c98-40b28383e89a req-0c863d04-c76d-45c2-8d06-ba5d221e767f service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:50.538273 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fcc2c539-b877-441f-9cf5-3527f93808ff tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.538958 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fcc2c539-b877-441f-9cf5-3527f93808ff tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:50.553620 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-e26ecf66-9b8d-4d4d-9c98-40b28383e89a req-0c863d04-c76d-45c2-8d06-ba5d221e767f service nova] Creating event network-vif-deleted:a424f220-1812-4f50-ab01-68a1923ec96d for instance 32f50ef3-7864-4548-8230-12ddb5ef83a0 on hv-cinder-81899 Nov 24 16:08:50.559613 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-e26ecf66-9b8d-4d4d-9c98-40b28383e89a req-0c863d04-c76d-45c2-8d06-ba5d221e767f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095299 Nov 24 16:08:50.560611 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 266/553] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:08:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:08:50.640060 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.objects.instance [None req-fcc2c539-b877-441f-9cf5-3527f93808ff tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lazy-loading 'services' on Instance uuid 67b8eee7-879b-4194-b4ff-e8bc9c576fd1 {{(pid=116303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:08:50.727372 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fcc2c539-b877-441f-9cf5-3527f93808ff tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "DELETE /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1/os-volume_attachments/6bd861ad-5254-4177-aede-00b0afba4493" status: 202 len: 0 microversion: 2.1 time: 0.210336 Nov 24 16:08:50.727984 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 288/554] 10.222.0.72 () {58 vars in 1415 bytes} [Wed Nov 24 16:08:50 2021] DELETE /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1/os-volume_attachments/6bd861ad-5254-4177-aede-00b0afba4493 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:08:50.737834 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ecf5c3ac-52e1-423e-b39c-77c75b64f67a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:50.740678 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ecf5c3ac-52e1-423e-b39c-77c75b64f67a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:50.748650 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ecf5c3ac-52e1-423e-b39c-77c75b64f67a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.750158 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ecf5c3ac-52e1-423e-b39c-77c75b64f67a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:50.751910 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ecf5c3ac-52e1-423e-b39c-77c75b64f67a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.753063 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ecf5c3ac-52e1-423e-b39c-77c75b64f67a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:50.786207 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-89bbe7c6-67cf-4890-af22-c07fa1ebcf12 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:50.787016 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-89bbe7c6-67cf-4890-af22-c07fa1ebcf12 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:50.797077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ecf5c3ac-52e1-423e-b39c-77c75b64f67a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064426 Nov 24 16:08:50.797214 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-89bbe7c6-67cf-4890-af22-c07fa1ebcf12 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.798574 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 267/555] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:08:50 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:08:50.802940 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-89bbe7c6-67cf-4890-af22-c07fa1ebcf12 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:50.803674 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-89bbe7c6-67cf-4890-af22-c07fa1ebcf12 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:50.804126 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-89bbe7c6-67cf-4890-af22-c07fa1ebcf12 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:51.012806 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-89bbe7c6-67cf-4890-af22-c07fa1ebcf12 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:51.021361 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-89bbe7c6-67cf-4890-af22-c07fa1ebcf12 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1359 microversion: 2.1 time: 0.238551 Nov 24 16:08:51.022455 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 289/556] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:50 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:51.153083 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8e01593b-c54b-4a48-8692-b054426a2574 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:51.153974 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8e01593b-c54b-4a48-8692-b054426a2574 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:51.160972 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8e01593b-c54b-4a48-8692-b054426a2574 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:51.162005 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8e01593b-c54b-4a48-8692-b054426a2574 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:51.163051 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8e01593b-c54b-4a48-8692-b054426a2574 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:51.163544 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8e01593b-c54b-4a48-8692-b054426a2574 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:51.283145 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8e01593b-c54b-4a48-8692-b054426a2574 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 37931 microversion: 2.1 time: 0.133842 Nov 24 16:08:51.283801 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 268/557] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:51 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 37931 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:08:51.350671 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-49f2dc9e-2c16-4a99-9d44-5b681d54fd35 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:51.351327 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-49f2dc9e-2c16-4a99-9d44-5b681d54fd35 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:51.357772 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-49f2dc9e-2c16-4a99-9d44-5b681d54fd35 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:51.358220 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-49f2dc9e-2c16-4a99-9d44-5b681d54fd35 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:51.359005 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-49f2dc9e-2c16-4a99-9d44-5b681d54fd35 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:51.359441 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-49f2dc9e-2c16-4a99-9d44-5b681d54fd35 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:51.392583 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-49f2dc9e-2c16-4a99-9d44-5b681d54fd35 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:51.393047 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-49f2dc9e-2c16-4a99-9d44-5b681d54fd35 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:51.393669 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.objects.instance [None req-49f2dc9e-2c16-4a99-9d44-5b681d54fd35 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lazy-loading 'fault' on Instance uuid 32f50ef3-7864-4548-8230-12ddb5ef83a0 {{(pid=116303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:08:51.439190 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-49f2dc9e-2c16-4a99-9d44-5b681d54fd35 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:51.447621 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-49f2dc9e-2c16-4a99-9d44-5b681d54fd35 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 200 len: 1312 microversion: 2.1 time: 0.101587 Nov 24 16:08:51.448441 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 290/558] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:51 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:51.810501 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7c470b0d-f9e8-4191-99e4-cbb5c0c1b319 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:51.811514 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7c470b0d-f9e8-4191-99e4-cbb5c0c1b319 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:51.819870 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7c470b0d-f9e8-4191-99e4-cbb5c0c1b319 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:51.820467 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7c470b0d-f9e8-4191-99e4-cbb5c0c1b319 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:51.821440 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7c470b0d-f9e8-4191-99e4-cbb5c0c1b319 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:51.822001 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7c470b0d-f9e8-4191-99e4-cbb5c0c1b319 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:51.859724 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7c470b0d-f9e8-4191-99e4-cbb5c0c1b319 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053374 Nov 24 16:08:51.860671 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 269/559] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:08:51 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:08:52.039702 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b8baa009-5de8-4e46-bf33-ee750424792b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:52.040444 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b8baa009-5de8-4e46-bf33-ee750424792b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:52.048003 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b8baa009-5de8-4e46-bf33-ee750424792b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:52.048473 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b8baa009-5de8-4e46-bf33-ee750424792b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:52.049287 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b8baa009-5de8-4e46-bf33-ee750424792b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:52.049723 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b8baa009-5de8-4e46-bf33-ee750424792b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:52.205841 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b8baa009-5de8-4e46-bf33-ee750424792b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:52.219175 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b8baa009-5de8-4e46-bf33-ee750424792b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1359 microversion: 2.1 time: 0.183236 Nov 24 16:08:52.219809 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 291/560] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:52 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:52.296489 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-503d03e8-7d0e-4f5d-9e35-10ec84e0f089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:52.297420 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-503d03e8-7d0e-4f5d-9e35-10ec84e0f089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:52.306069 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-503d03e8-7d0e-4f5d-9e35-10ec84e0f089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:52.306526 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-503d03e8-7d0e-4f5d-9e35-10ec84e0f089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:52.307396 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-503d03e8-7d0e-4f5d-9e35-10ec84e0f089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:52.307809 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-503d03e8-7d0e-4f5d-9e35-10ec84e0f089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:52.428305 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-503d03e8-7d0e-4f5d-9e35-10ec84e0f089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 38074 microversion: 2.1 time: 0.135591 Nov 24 16:08:52.428970 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 270/561] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:52 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 38074 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:52.471533 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6d61bd51-904c-4dec-ba15-eac70a1efa05 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:52.472249 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6d61bd51-904c-4dec-ba15-eac70a1efa05 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: 32f50ef3-7864-4548-8230-12ddb5ef83a0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:52.481077 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6d61bd51-904c-4dec-ba15-eac70a1efa05 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:52.481535 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6d61bd51-904c-4dec-ba15-eac70a1efa05 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:52.482448 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6d61bd51-904c-4dec-ba15-eac70a1efa05 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:52.482946 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6d61bd51-904c-4dec-ba15-eac70a1efa05 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:52.499512 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-6d61bd51-904c-4dec-ba15-eac70a1efa05 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] HTTP exception thrown: Instance 32f50ef3-7864-4548-8230-12ddb5ef83a0 could not be found. Nov 24 16:08:52.500133 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6d61bd51-904c-4dec-ba15-eac70a1efa05 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Returning 404 to user: Instance 32f50ef3-7864-4548-8230-12ddb5ef83a0 could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:08:52.501958 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6d61bd51-904c-4dec-ba15-eac70a1efa05 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0" status: 404 len: 111 microversion: 2.1 time: 0.033538 Nov 24 16:08:52.502171 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 292/562] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:52 2021] GET /compute/v2.1/servers/32f50ef3-7864-4548-8230-12ddb5ef83a0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:08:52.514606 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-befddac2-e570-48af-8291-1a07f1f89a87 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:52.515641 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-befddac2-e570-48af-8291-1a07f1f89a87 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:52.525742 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-befddac2-e570-48af-8291-1a07f1f89a87 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:52.526723 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-befddac2-e570-48af-8291-1a07f1f89a87 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:52.528277 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-befddac2-e570-48af-8291-1a07f1f89a87 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:52.529058 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-befddac2-e570-48af-8291-1a07f1f89a87 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:52.571903 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-befddac2-e570-48af-8291-1a07f1f89a87 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:08:52.677799 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-befddac2-e570-48af-8291-1a07f1f89a87 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 204 len: 0 microversion: 2.1 time: 0.169145 Nov 24 16:08:52.678836 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 271/563] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:08:52 2021] DELETE /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 16:08:52.687417 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-22761de0-4ecc-4a3c-ab0a-613130dcc9cd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:52.688044 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-22761de0-4ecc-4a3c-ab0a-613130dcc9cd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:52.696909 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-22761de0-4ecc-4a3c-ab0a-613130dcc9cd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:52.697482 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-22761de0-4ecc-4a3c-ab0a-613130dcc9cd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:52.698340 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-22761de0-4ecc-4a3c-ab0a-613130dcc9cd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:52.698796 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-22761de0-4ecc-4a3c-ab0a-613130dcc9cd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:52.841378 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-22761de0-4ecc-4a3c-ab0a-613130dcc9cd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:52.849400 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-22761de0-4ecc-4a3c-ab0a-613130dcc9cd tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.165309 Nov 24 16:08:52.849978 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 293/564] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:52 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:52.875117 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-787e2a3c-d0d2-4634-8bd8-6f609dacc203 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:52.876452 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-787e2a3c-d0d2-4634-8bd8-6f609dacc203 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:52.886528 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-787e2a3c-d0d2-4634-8bd8-6f609dacc203 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:52.886981 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-787e2a3c-d0d2-4634-8bd8-6f609dacc203 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:52.887986 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-787e2a3c-d0d2-4634-8bd8-6f609dacc203 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:52.888396 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-787e2a3c-d0d2-4634-8bd8-6f609dacc203 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:52.919833 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-787e2a3c-d0d2-4634-8bd8-6f609dacc203 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048826 Nov 24 16:08:52.920415 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 272/565] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:08:52 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:08:53.170841 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:53.171457 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:53.178316 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.178855 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.179733 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.180467 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.205690 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.objects.instance [None req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lazy-loading 'flavor' on Instance uuid 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 {{(pid=116303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:08:53.242757 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-79d613b9-2585-4a6c-a676-f977de3b426f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:53.243367 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-79d613b9-2585-4a6c-a676-f977de3b426f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:53.249603 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79d613b9-2585-4a6c-a676-f977de3b426f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.250045 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79d613b9-2585-4a6c-a676-f977de3b426f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.251091 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79d613b9-2585-4a6c-a676-f977de3b426f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.251521 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79d613b9-2585-4a6c-a676-f977de3b426f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.388986 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-79d613b9-2585-4a6c-a676-f977de3b426f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:53.397882 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-79d613b9-2585-4a6c-a676-f977de3b426f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1550 microversion: 2.1 time: 0.159279 Nov 24 16:08:53.401549 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 273/566] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:53 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:53.415520 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c6ed2393-b14e-4809-94c6-0a90e53b60e0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:53.416512 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c6ed2393-b14e-4809-94c6-0a90e53b60e0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:53.422854 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6ed2393-b14e-4809-94c6-0a90e53b60e0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.423237 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6ed2393-b14e-4809-94c6-0a90e53b60e0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.424015 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6ed2393-b14e-4809-94c6-0a90e53b60e0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.424523 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6ed2393-b14e-4809-94c6-0a90e53b60e0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.507987 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f73cdc2e-fd5d-455c-a98e-97b3c288de31 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 202 len: 0 microversion: 2.20 time: 0.340657 Nov 24 16:08:53.509008 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 294/567] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:08:53 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:08:53.514222 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0c2edeb2-cbad-43e0-b064-dfde2fd496e0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:53.515214 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0c2edeb2-cbad-43e0-b064-dfde2fd496e0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:53.522702 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0c2edeb2-cbad-43e0-b064-dfde2fd496e0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.523500 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0c2edeb2-cbad-43e0-b064-dfde2fd496e0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.524402 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0c2edeb2-cbad-43e0-b064-dfde2fd496e0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.524946 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0c2edeb2-cbad-43e0-b064-dfde2fd496e0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.589599 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c6ed2393-b14e-4809-94c6-0a90e53b60e0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:53.597925 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c6ed2393-b14e-4809-94c6-0a90e53b60e0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1550 microversion: 2.1 time: 0.186745 Nov 24 16:08:53.599166 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 274/568] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:53 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1550 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:53.603424 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ce142965-bb5d-4e4c-98ba-6cf8d561039b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:53.604133 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ce142965-bb5d-4e4c-98ba-6cf8d561039b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:53.611014 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce142965-bb5d-4e4c-98ba-6cf8d561039b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.611721 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce142965-bb5d-4e4c-98ba-6cf8d561039b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.612538 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce142965-bb5d-4e4c-98ba-6cf8d561039b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.612975 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ce142965-bb5d-4e4c-98ba-6cf8d561039b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.637420 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0c2edeb2-cbad-43e0-b064-dfde2fd496e0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 38074 microversion: 2.1 time: 0.126941 Nov 24 16:08:53.641576 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 295/569] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:53 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 38074 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:53.642834 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-839f25d9-2d55-4fd8-87d2-7ff87bc1502d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:53.646790 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:08:53.646790 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:08:53.647789 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-839f25d9-2d55-4fd8-87d2-7ff87bc1502d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:53.648530 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-839f25d9-2d55-4fd8-87d2-7ff87bc1502d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Searching by: {'deleted': False, 'project_id': '3b09c1b1b2994015967d00aba299005b'} {{(pid=116303) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 24 16:08:53.656267 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-839f25d9-2d55-4fd8-87d2-7ff87bc1502d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.656711 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-839f25d9-2d55-4fd8-87d2-7ff87bc1502d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.657607 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-839f25d9-2d55-4fd8-87d2-7ff87bc1502d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.657978 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-839f25d9-2d55-4fd8-87d2-7ff87bc1502d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.767868 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.multi_cell_list [None req-839f25d9-2d55-4fd8-87d2-7ff87bc1502d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116303) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 24 16:08:53.771080 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ce142965-bb5d-4e4c-98ba-6cf8d561039b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:53.779018 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ce142965-bb5d-4e4c-98ba-6cf8d561039b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:53.780525 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ce142965-bb5d-4e4c-98ba-6cf8d561039b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:53.781716 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ce142965-bb5d-4e4c-98ba-6cf8d561039b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.181643 Nov 24 16:08:53.782284 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 275/570] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:08:53 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:08:53.867397 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d4e66328-100c-46af-beac-43e0e9561634 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:53.868009 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d4e66328-100c-46af-beac-43e0e9561634 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:53.868285 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-839f25d9-2d55-4fd8-87d2-7ff87bc1502d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.229013 Nov 24 16:08:53.868886 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 296/571] 10.222.0.72 () {58 vars in 1124 bytes} [Wed Nov 24 16:08:53 2021] GET /compute/v2.1/servers => generated 343 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:08:53.874446 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d4e66328-100c-46af-beac-43e0e9561634 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.874971 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d4e66328-100c-46af-beac-43e0e9561634 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.876111 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d4e66328-100c-46af-beac-43e0e9561634 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.876706 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d4e66328-100c-46af-beac-43e0e9561634 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.879630 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-055a1e73-6bfe-47a6-ae88-1e4810325a6f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:53.880405 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-055a1e73-6bfe-47a6-ae88-1e4810325a6f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:53.888461 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-055a1e73-6bfe-47a6-ae88-1e4810325a6f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.888714 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-055a1e73-6bfe-47a6-ae88-1e4810325a6f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:53.889492 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-055a1e73-6bfe-47a6-ae88-1e4810325a6f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:53.889932 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-055a1e73-6bfe-47a6-ae88-1e4810325a6f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:54.041208 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d4e66328-100c-46af-beac-43e0e9561634 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:54.045680 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-055a1e73-6bfe-47a6-ae88-1e4810325a6f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:54.048850 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d4e66328-100c-46af-beac-43e0e9561634 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.186075 Nov 24 16:08:54.049542 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 276/572] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:53 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:54.054876 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-055a1e73-6bfe-47a6-ae88-1e4810325a6f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1550 microversion: 2.1 time: 0.178793 Nov 24 16:08:54.054876 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 297/573] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:53 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1550 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:54.120466 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:54.121074 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:54.127127 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:54.127580 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:54.128357 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:54.128793 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:54.155512 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:08:54.240141 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ffc1b27f-071a-450d-98bb-41cf26fb1ae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "DELETE /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 204 len: 0 microversion: 2.1 time: 0.122936 Nov 24 16:08:54.240873 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 277/574] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:08:54 2021] DELETE /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:08:54.251300 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d26c8ca6-d454-4766-a1d1-63592855f116 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:54.252161 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d26c8ca6-d454-4766-a1d1-63592855f116 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:54.259303 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d26c8ca6-d454-4766-a1d1-63592855f116 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:54.259773 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d26c8ca6-d454-4766-a1d1-63592855f116 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:54.260559 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d26c8ca6-d454-4766-a1d1-63592855f116 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:54.260986 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d26c8ca6-d454-4766-a1d1-63592855f116 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:54.426622 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d26c8ca6-d454-4766-a1d1-63592855f116 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:54.436869 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d26c8ca6-d454-4766-a1d1-63592855f116 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1513 microversion: 2.1 time: 0.190601 Nov 24 16:08:54.438057 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 298/575] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:54 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:54.650578 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a990930b-a709-4262-801d-8858ee6230b7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:54.651521 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a990930b-a709-4262-801d-8858ee6230b7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:54.657429 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a990930b-a709-4262-801d-8858ee6230b7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:54.657879 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a990930b-a709-4262-801d-8858ee6230b7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:54.658649 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a990930b-a709-4262-801d-8858ee6230b7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:54.659083 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a990930b-a709-4262-801d-8858ee6230b7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:54.761312 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a990930b-a709-4262-801d-8858ee6230b7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 38074 microversion: 2.1 time: 0.114682 Nov 24 16:08:54.762004 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 278/576] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:54 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 38074 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:54.800816 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-32256fac-2e89-4c46-8414-2e93776b1c44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:54.802141 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-32256fac-2e89-4c46-8414-2e93776b1c44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:54.808454 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-32256fac-2e89-4c46-8414-2e93776b1c44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:54.808890 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-32256fac-2e89-4c46-8414-2e93776b1c44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:54.809703 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-32256fac-2e89-4c46-8414-2e93776b1c44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:54.810125 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-32256fac-2e89-4c46-8414-2e93776b1c44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:54.955113 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-32256fac-2e89-4c46-8414-2e93776b1c44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:54.964056 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-32256fac-2e89-4c46-8414-2e93776b1c44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:54.965589 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-32256fac-2e89-4c46-8414-2e93776b1c44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:54.966750 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-32256fac-2e89-4c46-8414-2e93776b1c44 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.169703 Nov 24 16:08:54.967328 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 299/577] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:08:54 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:08:55.067313 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7aff22b7-97d0-44d8-814d-244445796fb5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:55.068188 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7aff22b7-97d0-44d8-814d-244445796fb5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:55.075276 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7aff22b7-97d0-44d8-814d-244445796fb5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:55.075723 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7aff22b7-97d0-44d8-814d-244445796fb5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:55.076556 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7aff22b7-97d0-44d8-814d-244445796fb5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:55.076988 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7aff22b7-97d0-44d8-814d-244445796fb5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:55.234792 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7aff22b7-97d0-44d8-814d-244445796fb5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:55.248227 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7aff22b7-97d0-44d8-814d-244445796fb5 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.184952 Nov 24 16:08:55.248879 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 279/578] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:55 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:55.455473 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1429f241-bf40-4090-bf60-0d7b49666375 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:55.456071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1429f241-bf40-4090-bf60-0d7b49666375 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:55.463466 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1429f241-bf40-4090-bf60-0d7b49666375 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:55.463910 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1429f241-bf40-4090-bf60-0d7b49666375 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:55.464680 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1429f241-bf40-4090-bf60-0d7b49666375 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:55.465138 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1429f241-bf40-4090-bf60-0d7b49666375 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:55.599179 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1429f241-bf40-4090-bf60-0d7b49666375 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:55.606385 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1429f241-bf40-4090-bf60-0d7b49666375 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1513 microversion: 2.1 time: 0.154589 Nov 24 16:08:55.606946 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 300/579] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:55 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:55.773836 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-53952191-b9ba-4b9a-8c68-5a6c59d2d6f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:55.774745 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-53952191-b9ba-4b9a-8c68-5a6c59d2d6f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:55.781070 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-53952191-b9ba-4b9a-8c68-5a6c59d2d6f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:55.781517 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-53952191-b9ba-4b9a-8c68-5a6c59d2d6f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:55.782289 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-53952191-b9ba-4b9a-8c68-5a6c59d2d6f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:55.782716 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-53952191-b9ba-4b9a-8c68-5a6c59d2d6f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:55.879623 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-53952191-b9ba-4b9a-8c68-5a6c59d2d6f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 200 len: 38201 microversion: 2.1 time: 0.109733 Nov 24 16:08:55.880185 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 280/580] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:08:55 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 38201 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:08:55.890535 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2ed9231b-c079-4123-8962-a83f53bbca6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:55.891106 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2ed9231b-c079-4123-8962-a83f53bbca6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:55.898240 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ed9231b-c079-4123-8962-a83f53bbca6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:55.898693 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ed9231b-c079-4123-8962-a83f53bbca6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:55.899480 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ed9231b-c079-4123-8962-a83f53bbca6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:55.899916 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2ed9231b-c079-4123-8962-a83f53bbca6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:55.924831 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2ed9231b-c079-4123-8962-a83f53bbca6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/ips" status: 200 len: 146 microversion: 2.1 time: 0.037866 Nov 24 16:08:55.925511 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 301/581] 10.222.0.72 () {58 vars in 1247 bytes} [Wed Nov 24 16:08:55 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:08:55.986660 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-30f56220-11ff-4eec-a6bf-0074f1e0c090 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:55.987388 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-30f56220-11ff-4eec-a6bf-0074f1e0c090 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:55.994474 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-30f56220-11ff-4eec-a6bf-0074f1e0c090 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:55.994925 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-30f56220-11ff-4eec-a6bf-0074f1e0c090 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:55.995719 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-30f56220-11ff-4eec-a6bf-0074f1e0c090 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:55.996159 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-30f56220-11ff-4eec-a6bf-0074f1e0c090 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:56.138953 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-30f56220-11ff-4eec-a6bf-0074f1e0c090 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:56.147992 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-30f56220-11ff-4eec-a6bf-0074f1e0c090 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:56.149579 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-30f56220-11ff-4eec-a6bf-0074f1e0c090 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:56.150740 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-30f56220-11ff-4eec-a6bf-0074f1e0c090 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.168180 Nov 24 16:08:56.151296 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 281/582] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:08:55 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:08:56.277448 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3f5522af-f39e-4da8-9589-1073bb9306ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:56.278080 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3f5522af-f39e-4da8-9589-1073bb9306ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:56.285210 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f5522af-f39e-4da8-9589-1073bb9306ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:56.285695 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f5522af-f39e-4da8-9589-1073bb9306ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:56.286651 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f5522af-f39e-4da8-9589-1073bb9306ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:56.287086 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f5522af-f39e-4da8-9589-1073bb9306ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:56.429958 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3f5522af-f39e-4da8-9589-1073bb9306ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:56.447440 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3f5522af-f39e-4da8-9589-1073bb9306ad tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.173410 Nov 24 16:08:56.448503 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 302/583] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:56 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:56.623633 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a73f5477-915b-49c6-bbdc-ac765883b10e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:56.624246 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a73f5477-915b-49c6-bbdc-ac765883b10e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:56.631544 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a73f5477-915b-49c6-bbdc-ac765883b10e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:56.632002 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a73f5477-915b-49c6-bbdc-ac765883b10e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:56.632803 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a73f5477-915b-49c6-bbdc-ac765883b10e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:56.633267 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a73f5477-915b-49c6-bbdc-ac765883b10e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:56.678162 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-95533f17-c9c4-4ddc-a1ad-c8b6fb709125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "877c7a1f-320b-4ed5-a3ac-c63b334cb95b"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:56.679857 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-95533f17-c9c4-4ddc-a1ad-c8b6fb709125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:56.690053 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-95533f17-c9c4-4ddc-a1ad-c8b6fb709125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:56.690815 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-95533f17-c9c4-4ddc-a1ad-c8b6fb709125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:56.693317 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-95533f17-c9c4-4ddc-a1ad-c8b6fb709125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:56.694413 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-95533f17-c9c4-4ddc-a1ad-c8b6fb709125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:56.796592 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a73f5477-915b-49c6-bbdc-ac765883b10e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:56.805529 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a73f5477-915b-49c6-bbdc-ac765883b10e tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1513 microversion: 2.1 time: 0.185513 Nov 24 16:08:56.806141 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 282/584] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:56 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:57.002572 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-95533f17-c9c4-4ddc-a1ad-c8b6fb709125 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "POST /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331450 Nov 24 16:08:57.003336 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 303/585] 10.222.0.72 () {60 vars in 1322 bytes} [Wed Nov 24 16:08:56 2021] POST /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:08:57.174491 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f42f2bdd-1e00-4559-9c7a-abec2754abf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:57.175505 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f42f2bdd-1e00-4559-9c7a-abec2754abf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:57.190245 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f42f2bdd-1e00-4559-9c7a-abec2754abf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:57.190245 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f42f2bdd-1e00-4559-9c7a-abec2754abf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:57.191323 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f42f2bdd-1e00-4559-9c7a-abec2754abf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:57.192292 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f42f2bdd-1e00-4559-9c7a-abec2754abf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:57.481864 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b4129a44-5aa0-4007-b86d-e45676696e10 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:57.483042 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b4129a44-5aa0-4007-b86d-e45676696e10 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:57.493371 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b4129a44-5aa0-4007-b86d-e45676696e10 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:57.494141 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b4129a44-5aa0-4007-b86d-e45676696e10 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:57.495652 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b4129a44-5aa0-4007-b86d-e45676696e10 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:57.496671 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b4129a44-5aa0-4007-b86d-e45676696e10 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:57.704686 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b4129a44-5aa0-4007-b86d-e45676696e10 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:57.721676 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b4129a44-5aa0-4007-b86d-e45676696e10 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.247318 Nov 24 16:08:57.734395 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 304/586] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:57 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:08:57.779072 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f42f2bdd-1e00-4559-9c7a-abec2754abf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:57.789443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f42f2bdd-1e00-4559-9c7a-abec2754abf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:57.792190 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f42f2bdd-1e00-4559-9c7a-abec2754abf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:57.794069 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f42f2bdd-1e00-4559-9c7a-abec2754abf4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.627683 Nov 24 16:08:57.795394 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 283/587] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:08:57 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:08:57.827836 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e7b5c53b-a11c-4f1c-ac69-2f90a8b38fa6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:57.828811 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e7b5c53b-a11c-4f1c-ac69-2f90a8b38fa6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:57.837422 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e7b5c53b-a11c-4f1c-ac69-2f90a8b38fa6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:57.838002 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e7b5c53b-a11c-4f1c-ac69-2f90a8b38fa6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:57.838852 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e7b5c53b-a11c-4f1c-ac69-2f90a8b38fa6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:57.839290 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e7b5c53b-a11c-4f1c-ac69-2f90a8b38fa6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:58.037602 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e7b5c53b-a11c-4f1c-ac69-2f90a8b38fa6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:58.048695 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e7b5c53b-a11c-4f1c-ac69-2f90a8b38fa6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 200 len: 1513 microversion: 2.1 time: 0.225967 Nov 24 16:08:58.061984 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 305/588] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:57 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 1513 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:58.077316 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-b17a149d-22fc-4ef7-bdfe-1664221104e9 req-cd2ccc4b-b646-45dd-ab03-199d2034024d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b8eee7-879b-4194-b4ff-e8bc9c576fd1", "name": "network-vif-deleted", "tag": "a960049b-51b1-4158-8da6-316ecd0c7259"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:58.080578 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:08:58.080578 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:08:58.091873 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-b17a149d-22fc-4ef7-bdfe-1664221104e9 req-cd2ccc4b-b646-45dd-ab03-199d2034024d service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:58.092859 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-b17a149d-22fc-4ef7-bdfe-1664221104e9 req-cd2ccc4b-b646-45dd-ab03-199d2034024d service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:58.122877 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-b17a149d-22fc-4ef7-bdfe-1664221104e9 req-cd2ccc4b-b646-45dd-ab03-199d2034024d service nova] Creating event network-vif-deleted:a960049b-51b1-4158-8da6-316ecd0c7259 for instance 67b8eee7-879b-4194-b4ff-e8bc9c576fd1 on hv-cinder-81899 Nov 24 16:08:58.128923 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-b17a149d-22fc-4ef7-bdfe-1664221104e9 req-cd2ccc4b-b646-45dd-ab03-199d2034024d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055267 Nov 24 16:08:58.130094 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 284/589] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:08:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:08:58.746684 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-85276b69-542e-48d7-9e55-2fc56db4a64f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:58.747489 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-85276b69-542e-48d7-9e55-2fc56db4a64f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:58.755997 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-85276b69-542e-48d7-9e55-2fc56db4a64f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:58.756660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-85276b69-542e-48d7-9e55-2fc56db4a64f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:58.757815 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-85276b69-542e-48d7-9e55-2fc56db4a64f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:58.758411 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-85276b69-542e-48d7-9e55-2fc56db4a64f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:58.816404 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-344ed253-1eac-4a2b-a710-8445e8db976b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:58.818125 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-344ed253-1eac-4a2b-a710-8445e8db976b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:58.829194 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-344ed253-1eac-4a2b-a710-8445e8db976b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:58.830962 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-344ed253-1eac-4a2b-a710-8445e8db976b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:58.831825 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-344ed253-1eac-4a2b-a710-8445e8db976b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:58.832266 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-344ed253-1eac-4a2b-a710-8445e8db976b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:58.948055 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-85276b69-542e-48d7-9e55-2fc56db4a64f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:58.955670 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-85276b69-542e-48d7-9e55-2fc56db4a64f tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.212918 Nov 24 16:08:58.956261 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 306/590] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:58 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:08:58.964986 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3e6237a2-5dc6-4b22-8b14-0a9ba05c2f7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e597164f-3a7a-4d5f-acec-17142de4e3fb"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:08:58.965686 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3e6237a2-5dc6-4b22-8b14-0a9ba05c2f7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:58.973403 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e6237a2-5dc6-4b22-8b14-0a9ba05c2f7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:58.974070 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e6237a2-5dc6-4b22-8b14-0a9ba05c2f7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:58.975259 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e6237a2-5dc6-4b22-8b14-0a9ba05c2f7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:58.975918 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e6237a2-5dc6-4b22-8b14-0a9ba05c2f7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:59.068868 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-344ed253-1eac-4a2b-a710-8445e8db976b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:59.085550 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-344ed253-1eac-4a2b-a710-8445e8db976b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:59.088976 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-344ed253-1eac-4a2b-a710-8445e8db976b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:08:59.091354 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-344ed253-1eac-4a2b-a710-8445e8db976b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.279677 Nov 24 16:08:59.092477 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 285/591] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:08:58 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:08:59.100921 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-72dad83b-863d-4dbf-8db7-330bf28f125b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:59.102062 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-72dad83b-863d-4dbf-8db7-330bf28f125b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 67b8eee7-879b-4194-b4ff-e8bc9c576fd1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:59.110309 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-72dad83b-863d-4dbf-8db7-330bf28f125b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:59.111101 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-72dad83b-863d-4dbf-8db7-330bf28f125b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:59.112590 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-72dad83b-863d-4dbf-8db7-330bf28f125b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:59.113442 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-72dad83b-863d-4dbf-8db7-330bf28f125b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:59.141463 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-72dad83b-863d-4dbf-8db7-330bf28f125b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] HTTP exception thrown: Instance 67b8eee7-879b-4194-b4ff-e8bc9c576fd1 could not be found. Nov 24 16:08:59.142600 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-72dad83b-863d-4dbf-8db7-330bf28f125b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Returning 404 to user: Instance 67b8eee7-879b-4194-b4ff-e8bc9c576fd1 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:08:59.144788 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-72dad83b-863d-4dbf-8db7-330bf28f125b tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1" status: 404 len: 111 microversion: 2.1 time: 0.050156 Nov 24 16:08:59.147075 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 286/592] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:59 2021] GET /compute/v2.1/servers/67b8eee7-879b-4194-b4ff-e8bc9c576fd1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:08:59.296582 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3e6237a2-5dc6-4b22-8b14-0a9ba05c2f7f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338722 Nov 24 16:08:59.298432 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 307/593] 10.222.0.72 () {60 vars in 1322 bytes} [Wed Nov 24 16:08:58 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:08:59.980868 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d5ae1d44-c81f-482d-85ec-daf60a499194 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:08:59.981489 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d5ae1d44-c81f-482d-85ec-daf60a499194 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:08:59.990381 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d5ae1d44-c81f-482d-85ec-daf60a499194 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:59.991122 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d5ae1d44-c81f-482d-85ec-daf60a499194 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:08:59.992471 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d5ae1d44-c81f-482d-85ec-daf60a499194 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:08:59.993248 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d5ae1d44-c81f-482d-85ec-daf60a499194 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:00.115616 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-06c90433-f440-45cd-a7e0-b13329e5c107 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:00.116337 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-06c90433-f440-45cd-a7e0-b13329e5c107 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:00.122535 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-06c90433-f440-45cd-a7e0-b13329e5c107 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:00.123018 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-06c90433-f440-45cd-a7e0-b13329e5c107 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:00.123812 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-06c90433-f440-45cd-a7e0-b13329e5c107 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:00.124242 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-06c90433-f440-45cd-a7e0-b13329e5c107 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:00.158360 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d5ae1d44-c81f-482d-85ec-daf60a499194 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:00.171759 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d5ae1d44-c81f-482d-85ec-daf60a499194 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.194100 Nov 24 16:09:00.172912 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 287/594] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:08:59 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:00.283178 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-06c90433-f440-45cd-a7e0-b13329e5c107 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:00.292246 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-06c90433-f440-45cd-a7e0-b13329e5c107 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:00.293856 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-06c90433-f440-45cd-a7e0-b13329e5c107 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:00.295309 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-06c90433-f440-45cd-a7e0-b13329e5c107 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.185485 Nov 24 16:09:00.295840 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 308/595] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:00 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:09:00.371597 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a185d2f3-8427-434a-8eff-ed466be000f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:00.372350 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a185d2f3-8427-434a-8eff-ed466be000f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:00.380413 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a185d2f3-8427-434a-8eff-ed466be000f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:00.381066 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a185d2f3-8427-434a-8eff-ed466be000f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:00.381952 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a185d2f3-8427-434a-8eff-ed466be000f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:00.383238 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a185d2f3-8427-434a-8eff-ed466be000f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:00.420886 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a185d2f3-8427-434a-8eff-ed466be000f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:09:00.531523 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a185d2f3-8427-434a-8eff-ed466be000f6 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "DELETE /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 204 len: 0 microversion: 2.1 time: 0.163723 Nov 24 16:09:00.532721 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 288/596] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:09:00 2021] DELETE /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:09:00.545764 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8a672bc0-b9b9-4d3a-b77c-f5541432e00a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:00.546471 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8a672bc0-b9b9-4d3a-b77c-f5541432e00a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:00.554955 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8a672bc0-b9b9-4d3a-b77c-f5541432e00a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:00.555407 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8a672bc0-b9b9-4d3a-b77c-f5541432e00a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:00.556194 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8a672bc0-b9b9-4d3a-b77c-f5541432e00a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:00.556626 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8a672bc0-b9b9-4d3a-b77c-f5541432e00a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:00.736517 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8a672bc0-b9b9-4d3a-b77c-f5541432e00a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:00.746535 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8a672bc0-b9b9-4d3a-b77c-f5541432e00a tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1513 microversion: 2.1 time: 0.206405 Nov 24 16:09:00.747094 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 309/597] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:00 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:01.191014 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ff1acf75-fab4-4649-9176-6d29965a30d7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:01.192438 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ff1acf75-fab4-4649-9176-6d29965a30d7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:01.200617 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ff1acf75-fab4-4649-9176-6d29965a30d7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:01.201126 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ff1acf75-fab4-4649-9176-6d29965a30d7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:01.201944 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ff1acf75-fab4-4649-9176-6d29965a30d7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:01.202385 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ff1acf75-fab4-4649-9176-6d29965a30d7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:01.318893 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a424f27f-5fe8-418f-bc4a-4db826724a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:01.320079 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a424f27f-5fe8-418f-bc4a-4db826724a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:01.329506 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a424f27f-5fe8-418f-bc4a-4db826724a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:01.330062 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a424f27f-5fe8-418f-bc4a-4db826724a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:01.330917 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a424f27f-5fe8-418f-bc4a-4db826724a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:01.331554 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a424f27f-5fe8-418f-bc4a-4db826724a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:01.459616 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ff1acf75-fab4-4649-9176-6d29965a30d7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadde7b294fa4dd784a9d55df7ba4a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b309e35e734edbaf96c844838de867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:01.470261 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ff1acf75-fab4-4649-9176-6d29965a30d7 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 200 len: 1521 microversion: 2.1 time: 0.283090 Nov 24 16:09:01.472513 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 289/598] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:01 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:09:01.554253 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a424f27f-5fe8-418f-bc4a-4db826724a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:01.571640 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a424f27f-5fe8-418f-bc4a-4db826724a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:01.575174 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a424f27f-5fe8-418f-bc4a-4db826724a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:01.578950 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a424f27f-5fe8-418f-bc4a-4db826724a14 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.266290 Nov 24 16:09:01.580854 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 310/599] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:01 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:01.639958 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-9a707240-263a-4425-b25d-5cc4517a951d req-b8805b77-4e2a-4d60-bd51-175c88d7f48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a9b563-1f54-4c61-923f-9b557a3c307b", "name": "network-vif-deleted", "tag": "533d257a-8aad-4722-8f01-84015f80cdd5"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:01.641556 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:09:01.641556 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:09:01.650412 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-9a707240-263a-4425-b25d-5cc4517a951d req-b8805b77-4e2a-4d60-bd51-175c88d7f48f service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:01.650852 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-9a707240-263a-4425-b25d-5cc4517a951d req-b8805b77-4e2a-4d60-bd51-175c88d7f48f service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:01.663969 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-9a707240-263a-4425-b25d-5cc4517a951d req-b8805b77-4e2a-4d60-bd51-175c88d7f48f service nova] Creating event network-vif-deleted:533d257a-8aad-4722-8f01-84015f80cdd5 for instance a3a9b563-1f54-4c61-923f-9b557a3c307b on hv-cinder-81899 Nov 24 16:09:01.669229 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-9a707240-263a-4425-b25d-5cc4517a951d req-b8805b77-4e2a-4d60-bd51-175c88d7f48f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032810 Nov 24 16:09:01.669912 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 290/600] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:09:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:01.764534 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2e26044e-aa58-4c88-9702-e675ff0279ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:01.765599 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2e26044e-aa58-4c88-9702-e675ff0279ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:01.773550 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2e26044e-aa58-4c88-9702-e675ff0279ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:01.774004 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2e26044e-aa58-4c88-9702-e675ff0279ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:01.774807 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2e26044e-aa58-4c88-9702-e675ff0279ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:01.775245 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2e26044e-aa58-4c88-9702-e675ff0279ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:01.934438 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-2e26044e-aa58-4c88-9702-e675ff0279ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:01.948671 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2e26044e-aa58-4c88-9702-e675ff0279ea tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1513 microversion: 2.1 time: 0.187921 Nov 24 16:09:01.949295 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 311/601] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:01 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:09:02.499940 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-17025ea4-3328-46fe-9e15-1b2a08831378 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:02.500903 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-17025ea4-3328-46fe-9e15-1b2a08831378 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] [instance: a3a9b563-1f54-4c61-923f-9b557a3c307b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:02.507586 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-17025ea4-3328-46fe-9e15-1b2a08831378 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:02.508037 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-17025ea4-3328-46fe-9e15-1b2a08831378 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:02.508832 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-17025ea4-3328-46fe-9e15-1b2a08831378 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:02.509303 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-17025ea4-3328-46fe-9e15-1b2a08831378 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:02.524117 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-17025ea4-3328-46fe-9e15-1b2a08831378 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] HTTP exception thrown: Instance a3a9b563-1f54-4c61-923f-9b557a3c307b could not be found. Nov 24 16:09:02.524721 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-17025ea4-3328-46fe-9e15-1b2a08831378 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] Returning 404 to user: Instance a3a9b563-1f54-4c61-923f-9b557a3c307b could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:09:02.525598 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-17025ea4-3328-46fe-9e15-1b2a08831378 tempest-ServerRescueNegativeTestJSON-2128500442 tempest-ServerRescueNegativeTestJSON-2128500442-project] 10.222.0.72 "GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b" status: 404 len: 111 microversion: 2.1 time: 0.030221 Nov 24 16:09:02.526166 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 291/602] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:02 2021] GET /compute/v2.1/servers/a3a9b563-1f54-4c61-923f-9b557a3c307b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:09:02.610018 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d1626711-2f9e-48b8-a522-175c83a27be2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:02.610866 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d1626711-2f9e-48b8-a522-175c83a27be2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:02.618228 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d1626711-2f9e-48b8-a522-175c83a27be2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:02.618666 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d1626711-2f9e-48b8-a522-175c83a27be2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:02.619688 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d1626711-2f9e-48b8-a522-175c83a27be2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:02.620120 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d1626711-2f9e-48b8-a522-175c83a27be2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:02.884673 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d1626711-2f9e-48b8-a522-175c83a27be2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:02.896633 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d1626711-2f9e-48b8-a522-175c83a27be2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:02.898803 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d1626711-2f9e-48b8-a522-175c83a27be2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:02.900102 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d1626711-2f9e-48b8-a522-175c83a27be2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.297990 Nov 24 16:09:02.900850 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 312/603] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:02 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:02.968004 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fda2e84f-44f5-4030-b6f4-9cdd6b340613 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:02.968727 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fda2e84f-44f5-4030-b6f4-9cdd6b340613 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:02.978521 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fda2e84f-44f5-4030-b6f4-9cdd6b340613 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:02.979081 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fda2e84f-44f5-4030-b6f4-9cdd6b340613 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:02.979897 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fda2e84f-44f5-4030-b6f4-9cdd6b340613 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:02.980336 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fda2e84f-44f5-4030-b6f4-9cdd6b340613 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:03.143151 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fda2e84f-44f5-4030-b6f4-9cdd6b340613 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:03.155395 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fda2e84f-44f5-4030-b6f4-9cdd6b340613 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1513 microversion: 2.1 time: 0.192132 Nov 24 16:09:03.156424 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 292/604] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:02 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:03.922652 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-260f1113-c9d5-490e-bf14-f6d312815bd7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:03.923482 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-260f1113-c9d5-490e-bf14-f6d312815bd7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:03.937200 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-260f1113-c9d5-490e-bf14-f6d312815bd7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:03.938009 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-260f1113-c9d5-490e-bf14-f6d312815bd7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:03.939006 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-260f1113-c9d5-490e-bf14-f6d312815bd7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:03.939443 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-260f1113-c9d5-490e-bf14-f6d312815bd7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:04.182306 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4e0d627a-cbc8-406c-ab70-576391301fe9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:04.183433 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4e0d627a-cbc8-406c-ab70-576391301fe9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:04.203820 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4e0d627a-cbc8-406c-ab70-576391301fe9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:04.204929 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4e0d627a-cbc8-406c-ab70-576391301fe9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:04.208113 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4e0d627a-cbc8-406c-ab70-576391301fe9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:04.209292 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4e0d627a-cbc8-406c-ab70-576391301fe9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:04.344140 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4e0d627a-cbc8-406c-ab70-576391301fe9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:04.353948 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4e0d627a-cbc8-406c-ab70-576391301fe9 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 200 len: 1471 microversion: 2.1 time: 0.182744 Nov 24 16:09:04.355348 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 293/605] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:04 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:04.360616 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-ff4ae74c-0886-4927-b9b1-b3de0794b873 req-7b00d9e8-336a-42e4-b1d5-b22944ce7ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0795a5-a12b-487a-8717-c9e4c33bd48c", "name": "network-vif-deleted", "tag": "f6b62b55-c282-46ef-a9ba-700f74a8fa81"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:04.362272 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:09:04.362272 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:09:04.384033 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-ff4ae74c-0886-4927-b9b1-b3de0794b873 req-7b00d9e8-336a-42e4-b1d5-b22944ce7ee7 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:04.385178 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-ff4ae74c-0886-4927-b9b1-b3de0794b873 req-7b00d9e8-336a-42e4-b1d5-b22944ce7ee7 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:04.411276 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-ff4ae74c-0886-4927-b9b1-b3de0794b873 req-7b00d9e8-336a-42e4-b1d5-b22944ce7ee7 service nova] Creating event network-vif-deleted:f6b62b55-c282-46ef-a9ba-700f74a8fa81 for instance 5d0795a5-a12b-487a-8717-c9e4c33bd48c on hv-cinder-81899 Nov 24 16:09:04.422827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-ff4ae74c-0886-4927-b9b1-b3de0794b873 req-7b00d9e8-336a-42e4-b1d5-b22944ce7ee7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065299 Nov 24 16:09:04.424367 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 294/606] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:09:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:04.444193 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-260f1113-c9d5-490e-bf14-f6d312815bd7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:04.460807 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-260f1113-c9d5-490e-bf14-f6d312815bd7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:04.463293 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-260f1113-c9d5-490e-bf14-f6d312815bd7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:04.464657 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-260f1113-c9d5-490e-bf14-f6d312815bd7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.546243 Nov 24 16:09:04.466263 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 313/607] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:03 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:05.389079 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9dc13d1f-5be7-47f6-8eff-39b49dfe6a7d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:05.390670 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9dc13d1f-5be7-47f6-8eff-39b49dfe6a7d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5d0795a5-a12b-487a-8717-c9e4c33bd48c] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:05.404032 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9dc13d1f-5be7-47f6-8eff-39b49dfe6a7d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:05.404930 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9dc13d1f-5be7-47f6-8eff-39b49dfe6a7d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:05.406562 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9dc13d1f-5be7-47f6-8eff-39b49dfe6a7d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:05.407345 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9dc13d1f-5be7-47f6-8eff-39b49dfe6a7d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:05.434242 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-9dc13d1f-5be7-47f6-8eff-39b49dfe6a7d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] HTTP exception thrown: Instance 5d0795a5-a12b-487a-8717-c9e4c33bd48c could not be found. Nov 24 16:09:05.435300 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9dc13d1f-5be7-47f6-8eff-39b49dfe6a7d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Returning 404 to user: Instance 5d0795a5-a12b-487a-8717-c9e4c33bd48c could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:09:05.436881 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9dc13d1f-5be7-47f6-8eff-39b49dfe6a7d tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c" status: 404 len: 111 microversion: 2.1 time: 0.060147 Nov 24 16:09:05.437904 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 295/608] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:05 2021] GET /compute/v2.1/servers/5d0795a5-a12b-487a-8717-c9e4c33bd48c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:09:05.454885 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:05.458064 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:05.475588 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:05.476566 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:05.478168 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:05.481796 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:05.487513 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e129c72d-3537-4070-83a2-6e2f6e4bf6bc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:05.488800 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e129c72d-3537-4070-83a2-6e2f6e4bf6bc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:05.496192 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e129c72d-3537-4070-83a2-6e2f6e4bf6bc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:05.496800 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e129c72d-3537-4070-83a2-6e2f6e4bf6bc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:05.497696 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e129c72d-3537-4070-83a2-6e2f6e4bf6bc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:05.498134 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e129c72d-3537-4070-83a2-6e2f6e4bf6bc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:05.562841 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Going to try to terminate instance {{(pid=116303) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:09:05.755191 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e60e9f32-bc2f-43e8-8716-cdf932a96f7f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "DELETE /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 204 len: 0 microversion: 2.1 time: 0.310418 Nov 24 16:09:05.756190 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 314/609] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:09:05 2021] DELETE /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:09:05.783028 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-acd98603-8de4-4176-ba19-9772d1979423 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:05.784768 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-acd98603-8de4-4176-ba19-9772d1979423 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:05.801784 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-acd98603-8de4-4176-ba19-9772d1979423 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:05.805369 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-acd98603-8de4-4176-ba19-9772d1979423 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:05.807245 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e129c72d-3537-4070-83a2-6e2f6e4bf6bc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:05.807720 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-acd98603-8de4-4176-ba19-9772d1979423 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:05.808254 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-acd98603-8de4-4176-ba19-9772d1979423 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:05.830330 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e129c72d-3537-4070-83a2-6e2f6e4bf6bc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:05.835664 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e129c72d-3537-4070-83a2-6e2f6e4bf6bc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:05.841676 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e129c72d-3537-4070-83a2-6e2f6e4bf6bc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.356988 Nov 24 16:09:05.856162 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 296/610] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:05 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:05.983462 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7e6c7fee-4788-487f-8997-4f8ec7cac57c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:05.984725 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7e6c7fee-4788-487f-8997-4f8ec7cac57c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:05.996647 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e6c7fee-4788-487f-8997-4f8ec7cac57c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:05.997459 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e6c7fee-4788-487f-8997-4f8ec7cac57c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:05.999522 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e6c7fee-4788-487f-8997-4f8ec7cac57c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:06.001201 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e6c7fee-4788-487f-8997-4f8ec7cac57c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:06.112165 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-acd98603-8de4-4176-ba19-9772d1979423 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:06.128060 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-acd98603-8de4-4176-ba19-9772d1979423 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1514 microversion: 2.1 time: 0.364796 Nov 24 16:09:06.130116 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 315/611] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:05 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1514 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:06.274350 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7e6c7fee-4788-487f-8997-4f8ec7cac57c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:06.287197 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7e6c7fee-4788-487f-8997-4f8ec7cac57c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1596 microversion: 2.1 time: 0.311006 Nov 24 16:09:06.288317 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 297/612] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:05 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1596 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:06.874429 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-73f6a777-2f35-45db-a421-facd4c678c77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:06.877396 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-73f6a777-2f35-45db-a421-facd4c678c77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:06.888782 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-73f6a777-2f35-45db-a421-facd4c678c77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:06.889537 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-73f6a777-2f35-45db-a421-facd4c678c77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:06.890533 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-73f6a777-2f35-45db-a421-facd4c678c77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:06.891153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-73f6a777-2f35-45db-a421-facd4c678c77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:07.146801 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-db6ecbd4-10fd-4cf0-8112-d30ebcd05d00 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:07.148107 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-db6ecbd4-10fd-4cf0-8112-d30ebcd05d00 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:07.182190 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-db6ecbd4-10fd-4cf0-8112-d30ebcd05d00 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:07.183008 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-db6ecbd4-10fd-4cf0-8112-d30ebcd05d00 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:07.186678 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-db6ecbd4-10fd-4cf0-8112-d30ebcd05d00 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:07.187588 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-db6ecbd4-10fd-4cf0-8112-d30ebcd05d00 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:07.272063 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-73f6a777-2f35-45db-a421-facd4c678c77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:07.288781 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-73f6a777-2f35-45db-a421-facd4c678c77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:07.294923 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-73f6a777-2f35-45db-a421-facd4c678c77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:07.297774 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-73f6a777-2f35-45db-a421-facd4c678c77 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.430517 Nov 24 16:09:07.299630 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 316/613] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:06 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:07.542706 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-db6ecbd4-10fd-4cf0-8112-d30ebcd05d00 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:07.554833 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-db6ecbd4-10fd-4cf0-8112-d30ebcd05d00 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1514 microversion: 2.1 time: 0.412365 Nov 24 16:09:07.566209 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 298/614] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:07 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1514 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:09:08.337398 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-396be9f3-87d3-47c0-82d9-c61d43c4aa5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:08.340678 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-396be9f3-87d3-47c0-82d9-c61d43c4aa5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:08.351973 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-396be9f3-87d3-47c0-82d9-c61d43c4aa5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:08.352462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-396be9f3-87d3-47c0-82d9-c61d43c4aa5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:08.353428 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-396be9f3-87d3-47c0-82d9-c61d43c4aa5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:08.353865 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-396be9f3-87d3-47c0-82d9-c61d43c4aa5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:08.523600 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-396be9f3-87d3-47c0-82d9-c61d43c4aa5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:08.540107 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-396be9f3-87d3-47c0-82d9-c61d43c4aa5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:08.541946 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-396be9f3-87d3-47c0-82d9-c61d43c4aa5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:08.543126 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-396be9f3-87d3-47c0-82d9-c61d43c4aa5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.214217 Nov 24 16:09:08.556031 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 317/615] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:08 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:08.578505 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b3bb248f-9583-4f98-97f6-31e93a5c74a2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:08.579736 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b3bb248f-9583-4f98-97f6-31e93a5c74a2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:08.592124 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b3bb248f-9583-4f98-97f6-31e93a5c74a2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:08.593003 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b3bb248f-9583-4f98-97f6-31e93a5c74a2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:08.594391 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b3bb248f-9583-4f98-97f6-31e93a5c74a2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:08.595287 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b3bb248f-9583-4f98-97f6-31e93a5c74a2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:09.059939 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-a67c49d2-ed74-43dd-937e-6d035c4bd311 req-e023a3d8-47ec-45c0-a024-343ce40df621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dbe3561-9e63-4d04-9c0f-563b85fa743f", "name": "network-vif-deleted", "tag": "3fa4f539-3c48-40d2-a56f-0717a9dc7259"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:09.061666 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:09:09.061666 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:09:09.073965 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-a67c49d2-ed74-43dd-937e-6d035c4bd311 req-e023a3d8-47ec-45c0-a024-343ce40df621 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:09.074411 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-a67c49d2-ed74-43dd-937e-6d035c4bd311 req-e023a3d8-47ec-45c0-a024-343ce40df621 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:09.088564 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-a67c49d2-ed74-43dd-937e-6d035c4bd311 req-e023a3d8-47ec-45c0-a024-343ce40df621 service nova] Creating event network-vif-deleted:3fa4f539-3c48-40d2-a56f-0717a9dc7259 for instance 5dbe3561-9e63-4d04-9c0f-563b85fa743f on hv-cinder-81899 Nov 24 16:09:09.095969 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-a67c49d2-ed74-43dd-937e-6d035c4bd311 req-e023a3d8-47ec-45c0-a024-343ce40df621 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042144 Nov 24 16:09:09.096971 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 318/616] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:09:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:09.175891 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b3bb248f-9583-4f98-97f6-31e93a5c74a2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:09.187147 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b3bb248f-9583-4f98-97f6-31e93a5c74a2 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 200 len: 1514 microversion: 2.1 time: 0.616108 Nov 24 16:09:09.188062 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 299/617] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:08 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 1514 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:09.562643 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2b9ae546-d876-4c18-9b42-c2bc2cee08de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:09.564041 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2b9ae546-d876-4c18-9b42-c2bc2cee08de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:09.570905 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2b9ae546-d876-4c18-9b42-c2bc2cee08de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:09.571795 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2b9ae546-d876-4c18-9b42-c2bc2cee08de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:09.572693 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2b9ae546-d876-4c18-9b42-c2bc2cee08de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:09.573251 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2b9ae546-d876-4c18-9b42-c2bc2cee08de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:09.786076 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-2b9ae546-d876-4c18-9b42-c2bc2cee08de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:09.797644 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-2b9ae546-d876-4c18-9b42-c2bc2cee08de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:09.802987 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-2b9ae546-d876-4c18-9b42-c2bc2cee08de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:09.809701 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2b9ae546-d876-4c18-9b42-c2bc2cee08de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.251374 Nov 24 16:09:09.811754 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 319/618] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:09 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:10.231076 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e6f3bd0a-2880-4e86-9140-5764d7918a50 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:10.232757 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e6f3bd0a-2880-4e86-9140-5764d7918a50 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: 5dbe3561-9e63-4d04-9c0f-563b85fa743f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:10.247788 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e6f3bd0a-2880-4e86-9140-5764d7918a50 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:10.248247 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e6f3bd0a-2880-4e86-9140-5764d7918a50 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:10.249115 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e6f3bd0a-2880-4e86-9140-5764d7918a50 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:10.249749 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e6f3bd0a-2880-4e86-9140-5764d7918a50 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:10.278908 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-e6f3bd0a-2880-4e86-9140-5764d7918a50 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] HTTP exception thrown: Instance 5dbe3561-9e63-4d04-9c0f-563b85fa743f could not be found. Nov 24 16:09:10.280350 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e6f3bd0a-2880-4e86-9140-5764d7918a50 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Returning 404 to user: Instance 5dbe3561-9e63-4d04-9c0f-563b85fa743f could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:09:10.282341 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e6f3bd0a-2880-4e86-9140-5764d7918a50 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f" status: 404 len: 111 microversion: 2.1 time: 0.067431 Nov 24 16:09:10.286948 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 300/619] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:10 2021] GET /compute/v2.1/servers/5dbe3561-9e63-4d04-9c0f-563b85fa743f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:09:10.831402 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a5be1861-47cd-42ad-ac50-6a6d061291e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:10.832300 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a5be1861-47cd-42ad-ac50-6a6d061291e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:10.843501 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a5be1861-47cd-42ad-ac50-6a6d061291e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:10.844030 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a5be1861-47cd-42ad-ac50-6a6d061291e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:10.845281 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a5be1861-47cd-42ad-ac50-6a6d061291e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:10.845749 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a5be1861-47cd-42ad-ac50-6a6d061291e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:11.094999 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a5be1861-47cd-42ad-ac50-6a6d061291e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:11.106469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a5be1861-47cd-42ad-ac50-6a6d061291e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:11.108403 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a5be1861-47cd-42ad-ac50-6a6d061291e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:11.109990 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a5be1861-47cd-42ad-ac50-6a6d061291e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1744 microversion: 2.20 time: 0.282512 Nov 24 16:09:11.111175 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 320/620] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:10 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1744 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:11.158530 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-203f14ae-fbf8-493a-b30a-ff089b7a5597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:11.163089 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:09:11.163089 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:09:11.181077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-203f14ae-fbf8-493a-b30a-ff089b7a5597 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:11.182670 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-203f14ae-fbf8-493a-b30a-ff089b7a5597 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:11.217895 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-203f14ae-fbf8-493a-b30a-ff089b7a5597 service nova] Creating event network-changed:fe858985-c82e-488e-aceb-25ed4bffc8ee for instance 47f17e69-ba46-4a11-8bfb-01e444817ac1 on hv-cinder-81899 Nov 24 16:09:11.226265 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-b9aa474c-4e52-4082-8039-23dc6dade5a0 req-203f14ae-fbf8-493a-b30a-ff089b7a5597 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073733 Nov 24 16:09:11.227415 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 301/621] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:09:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:11.287531 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-30f784b3-5ea2-4c19-99af-505ddda60cc3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1392222549"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:11.288738 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-30f784b3-5ea2-4c19-99af-505ddda60cc3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:11.315474 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-30f784b3-5ea2-4c19-99af-505ddda60cc3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:11.318126 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-30f784b3-5ea2-4c19-99af-505ddda60cc3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:11.321679 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-30f784b3-5ea2-4c19-99af-505ddda60cc3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:11.323607 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-30f784b3-5ea2-4c19-99af-505ddda60cc3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:11.524458 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:11.525871 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:11.541327 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:11.542683 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:11.545454 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:11.548091 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:11.588086 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:09:11.643777 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.network.security_group_api [None req-30f784b3-5ea2-4c19-99af-505ddda60cc3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Adding security group 497983bf-eca9-465b-ad1a-9718733e64c7 to port fe858985-c82e-488e-aceb-25ed4bffc8ee Nov 24 16:09:11.713708 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6ddc8d0f-47c9-45b4-80ce-da7f4b1ebdae tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 204 len: 0 microversion: 2.1 time: 0.195368 Nov 24 16:09:11.714311 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 302/622] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:09:11 2021] DELETE /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:09:11.728123 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1bc8bcbe-1a00-4c80-84c5-96bbaa8a5eef tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:11.728827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1bc8bcbe-1a00-4c80-84c5-96bbaa8a5eef tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:11.736513 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1bc8bcbe-1a00-4c80-84c5-96bbaa8a5eef tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:11.737409 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1bc8bcbe-1a00-4c80-84c5-96bbaa8a5eef tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:11.738801 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1bc8bcbe-1a00-4c80-84c5-96bbaa8a5eef tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:11.739586 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1bc8bcbe-1a00-4c80-84c5-96bbaa8a5eef tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:12.040806 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1bc8bcbe-1a00-4c80-84c5-96bbaa8a5eef tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:12.060952 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1bc8bcbe-1a00-4c80-84c5-96bbaa8a5eef tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1514 microversion: 2.1 time: 0.338495 Nov 24 16:09:12.078960 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 303/623] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:11 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1514 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:12.142689 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7dff19ed-e20e-4b5a-8799-d9a1f31b0a16 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:12.146137 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7dff19ed-e20e-4b5a-8799-d9a1f31b0a16 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:12.159050 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7dff19ed-e20e-4b5a-8799-d9a1f31b0a16 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:12.160547 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7dff19ed-e20e-4b5a-8799-d9a1f31b0a16 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:12.162570 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7dff19ed-e20e-4b5a-8799-d9a1f31b0a16 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:12.163629 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7dff19ed-e20e-4b5a-8799-d9a1f31b0a16 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:12.239672 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-30f784b3-5ea2-4c19-99af-505ddda60cc3 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "POST /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/action" status: 202 len: 0 microversion: 2.1 time: 0.966960 Nov 24 16:09:12.240474 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 321/624] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:09:11 2021] POST /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/action => generated 0 bytes in 970 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:09:12.250819 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-242ac144-b626-4502-a687-6eb67614abb9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:12.251684 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-242ac144-b626-4502-a687-6eb67614abb9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:12.274809 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-242ac144-b626-4502-a687-6eb67614abb9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:12.275761 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-242ac144-b626-4502-a687-6eb67614abb9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:12.277803 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-242ac144-b626-4502-a687-6eb67614abb9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:12.278872 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-242ac144-b626-4502-a687-6eb67614abb9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:12.508784 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7dff19ed-e20e-4b5a-8799-d9a1f31b0a16 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:12.535162 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7dff19ed-e20e-4b5a-8799-d9a1f31b0a16 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:12.546446 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7dff19ed-e20e-4b5a-8799-d9a1f31b0a16 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:12.547685 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7dff19ed-e20e-4b5a-8799-d9a1f31b0a16 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1744 microversion: 2.20 time: 0.420020 Nov 24 16:09:12.550427 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 304/625] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:12 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1744 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:12.566769 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-e8367bcd-d6ef-47ec-bb3b-3e997133b36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:12.568454 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:09:12.568454 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:09:12.578802 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-242ac144-b626-4502-a687-6eb67614abb9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:12.590506 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-242ac144-b626-4502-a687-6eb67614abb9 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1761 microversion: 2.1 time: 0.345172 Nov 24 16:09:12.591098 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 322/626] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:12 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1761 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:09:12.592896 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-e8367bcd-d6ef-47ec-bb3b-3e997133b36f service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:12.595749 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-e8367bcd-d6ef-47ec-bb3b-3e997133b36f service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:12.620521 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-e8367bcd-d6ef-47ec-bb3b-3e997133b36f service nova] Creating event network-changed:fe858985-c82e-488e-aceb-25ed4bffc8ee for instance 47f17e69-ba46-4a11-8bfb-01e444817ac1 on hv-cinder-81899 Nov 24 16:09:12.630027 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-bf6bb717-6a37-4d40-a217-16da11ff9e16 req-e8367bcd-d6ef-47ec-bb3b-3e997133b36f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074223 Nov 24 16:09:12.630938 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 305/627] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:09:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:12.717932 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7c8814da-2cc5-45bd-8f44-1a7ce4332fd5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:12.725670 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7c8814da-2cc5-45bd-8f44-1a7ce4332fd5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:12.726775 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7c8814da-2cc5-45bd-8f44-1a7ce4332fd5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:12.812146 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7c8814da-2cc5-45bd-8f44-1a7ce4332fd5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Going to try to stop instance {{(pid=116303) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 24 16:09:12.890578 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7c8814da-2cc5-45bd-8f44-1a7ce4332fd5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 202 len: 0 microversion: 2.1 time: 0.175367 Nov 24 16:09:12.893998 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 323/628] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:09:12 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:09:12.905481 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dae1ad2d-6422-4853-ab38-6c87d80ab00b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:12.906828 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dae1ad2d-6422-4853-ab38-6c87d80ab00b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:12.921004 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dae1ad2d-6422-4853-ab38-6c87d80ab00b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:12.922111 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dae1ad2d-6422-4853-ab38-6c87d80ab00b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:12.922967 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dae1ad2d-6422-4853-ab38-6c87d80ab00b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:12.923416 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dae1ad2d-6422-4853-ab38-6c87d80ab00b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:13.093563 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-dab28ee3-1daa-410d-9634-f54a45e1cae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:13.094548 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-dab28ee3-1daa-410d-9634-f54a45e1cae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:13.118027 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dab28ee3-1daa-410d-9634-f54a45e1cae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:13.119431 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dab28ee3-1daa-410d-9634-f54a45e1cae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:13.127542 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dab28ee3-1daa-410d-9634-f54a45e1cae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:13.129774 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dab28ee3-1daa-410d-9634-f54a45e1cae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:13.209645 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dae1ad2d-6422-4853-ab38-6c87d80ab00b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:13.224745 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dae1ad2d-6422-4853-ab38-6c87d80ab00b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.325335 Nov 24 16:09:13.240820 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 306/629] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:12 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:13.449216 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-dab28ee3-1daa-410d-9634-f54a45e1cae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:13.458497 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-dab28ee3-1daa-410d-9634-f54a45e1cae0 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1514 microversion: 2.1 time: 0.370161 Nov 24 16:09:13.460054 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 324/630] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:13 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1514 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:13.575349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9c9ff1e8-96a2-4d19-9610-4e9309d52e3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:13.577020 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9c9ff1e8-96a2-4d19-9610-4e9309d52e3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:13.588801 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9c9ff1e8-96a2-4d19-9610-4e9309d52e3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:13.589567 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9c9ff1e8-96a2-4d19-9610-4e9309d52e3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:13.590504 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9c9ff1e8-96a2-4d19-9610-4e9309d52e3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:13.592432 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9c9ff1e8-96a2-4d19-9610-4e9309d52e3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:13.805953 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9c9ff1e8-96a2-4d19-9610-4e9309d52e3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:13.815805 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9c9ff1e8-96a2-4d19-9610-4e9309d52e3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:13.819379 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9c9ff1e8-96a2-4d19-9610-4e9309d52e3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:13.820881 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9c9ff1e8-96a2-4d19-9610-4e9309d52e3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1744 microversion: 2.20 time: 0.258126 Nov 24 16:09:13.822336 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 307/631] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:13 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1744 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:13.997180 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-95d3654c-a838-46cb-830b-b313252b0d91 req-4e109aba-f291-4446-b144-e0005452ecff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-plugged", "status": "completed", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:13.999279 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:09:13.999279 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:09:14.008013 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-95d3654c-a838-46cb-830b-b313252b0d91 req-4e109aba-f291-4446-b144-e0005452ecff service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:14.008551 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-95d3654c-a838-46cb-830b-b313252b0d91 req-4e109aba-f291-4446-b144-e0005452ecff service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:14.022050 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-95d3654c-a838-46cb-830b-b313252b0d91 req-4e109aba-f291-4446-b144-e0005452ecff service nova] Creating event network-vif-plugged:0cc6f513-6305-463b-bb1d-17ec8928f67c for instance 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 on hv-cinder-81899 Nov 24 16:09:14.027415 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-95d3654c-a838-46cb-830b-b313252b0d91 req-4e109aba-f291-4446-b144-e0005452ecff service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033855 Nov 24 16:09:14.028711 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 325/632] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:09:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:14.248792 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e3894a43-25ea-4b82-86a4-858b470a6e83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:14.249429 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e3894a43-25ea-4b82-86a4-858b470a6e83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:14.256624 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e3894a43-25ea-4b82-86a4-858b470a6e83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:14.257096 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e3894a43-25ea-4b82-86a4-858b470a6e83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:14.257929 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e3894a43-25ea-4b82-86a4-858b470a6e83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:14.258360 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e3894a43-25ea-4b82-86a4-858b470a6e83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:14.398983 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e3894a43-25ea-4b82-86a4-858b470a6e83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:14.407207 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e3894a43-25ea-4b82-86a4-858b470a6e83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.162492 Nov 24 16:09:14.407806 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 308/633] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:14 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:14.481631 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-737b88d7-264c-4a29-be3c-ce71d76fac60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:14.483420 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-737b88d7-264c-4a29-be3c-ce71d76fac60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:14.497568 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-737b88d7-264c-4a29-be3c-ce71d76fac60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:14.498178 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-737b88d7-264c-4a29-be3c-ce71d76fac60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:14.498977 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-737b88d7-264c-4a29-be3c-ce71d76fac60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:14.499593 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-737b88d7-264c-4a29-be3c-ce71d76fac60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:14.660789 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-737b88d7-264c-4a29-be3c-ce71d76fac60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:14.668307 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-737b88d7-264c-4a29-be3c-ce71d76fac60 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1514 microversion: 2.1 time: 0.194861 Nov 24 16:09:14.669212 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 326/634] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:14 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:14.842640 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ffa7f2fe-f551-4dde-b863-91a3657a7ac3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:14.845351 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ffa7f2fe-f551-4dde-b863-91a3657a7ac3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:14.856626 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffa7f2fe-f551-4dde-b863-91a3657a7ac3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:14.857197 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffa7f2fe-f551-4dde-b863-91a3657a7ac3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:14.858143 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffa7f2fe-f551-4dde-b863-91a3657a7ac3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:14.866318 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffa7f2fe-f551-4dde-b863-91a3657a7ac3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:15.114831 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ffa7f2fe-f551-4dde-b863-91a3657a7ac3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:15.131331 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ffa7f2fe-f551-4dde-b863-91a3657a7ac3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:15.135082 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ffa7f2fe-f551-4dde-b863-91a3657a7ac3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:15.147641 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-78982bdd-e95a-4196-ac03-bd3013b88e0a req-20eeb879-f9e3-4508-89e2-9ca48fa51809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e069fb-95d8-4964-b82d-ca884fcb2b5e", "name": "network-vif-deleted", "tag": "691eb29c-951c-4f72-b283-76d5f14e961e"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:15.150300 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ffa7f2fe-f551-4dde-b863-91a3657a7ac3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1744 microversion: 2.20 time: 0.302343 Nov 24 16:09:15.167982 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 309/635] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:14 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1744 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:09:15.173499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:09:15.173499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:09:15.197859 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-78982bdd-e95a-4196-ac03-bd3013b88e0a req-20eeb879-f9e3-4508-89e2-9ca48fa51809 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:15.198727 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-78982bdd-e95a-4196-ac03-bd3013b88e0a req-20eeb879-f9e3-4508-89e2-9ca48fa51809 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:15.226695 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-78982bdd-e95a-4196-ac03-bd3013b88e0a req-20eeb879-f9e3-4508-89e2-9ca48fa51809 service nova] Creating event network-vif-deleted:691eb29c-951c-4f72-b283-76d5f14e961e for instance c7e069fb-95d8-4964-b82d-ca884fcb2b5e on hv-cinder-81899 Nov 24 16:09:15.232073 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-78982bdd-e95a-4196-ac03-bd3013b88e0a req-20eeb879-f9e3-4508-89e2-9ca48fa51809 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091991 Nov 24 16:09:15.233137 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 327/636] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:09:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:09:15.434347 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e2ef02ce-ec1f-4ce2-a8ce-dbda92450037 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:15.434950 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e2ef02ce-ec1f-4ce2-a8ce-dbda92450037 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:15.440887 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e2ef02ce-ec1f-4ce2-a8ce-dbda92450037 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:15.441939 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e2ef02ce-ec1f-4ce2-a8ce-dbda92450037 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:15.442726 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e2ef02ce-ec1f-4ce2-a8ce-dbda92450037 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:15.443166 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e2ef02ce-ec1f-4ce2-a8ce-dbda92450037 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:15.590258 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e2ef02ce-ec1f-4ce2-a8ce-dbda92450037 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:15.598452 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e2ef02ce-ec1f-4ce2-a8ce-dbda92450037 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.167712 Nov 24 16:09:15.599040 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 310/637] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:15 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:15.687083 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-17fbf0d7-0d07-4a7c-a278-4d1c177d69f4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:15.687797 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-17fbf0d7-0d07-4a7c-a278-4d1c177d69f4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:15.695470 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-17fbf0d7-0d07-4a7c-a278-4d1c177d69f4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:15.695925 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-17fbf0d7-0d07-4a7c-a278-4d1c177d69f4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:15.696729 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-17fbf0d7-0d07-4a7c-a278-4d1c177d69f4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:15.697210 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-17fbf0d7-0d07-4a7c-a278-4d1c177d69f4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:15.731096 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-17fbf0d7-0d07-4a7c-a278-4d1c177d69f4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:15.731540 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-17fbf0d7-0d07-4a7c-a278-4d1c177d69f4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:15.732003 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.objects.instance [None req-17fbf0d7-0d07-4a7c-a278-4d1c177d69f4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lazy-loading 'fault' on Instance uuid c7e069fb-95d8-4964-b82d-ca884fcb2b5e {{(pid=116303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:09:15.776620 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-17fbf0d7-0d07-4a7c-a278-4d1c177d69f4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe7f58143cd4ee2bc161e220fbbbd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20c9176ab8ef44ffb17eda5f41aca2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:15.784512 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-17fbf0d7-0d07-4a7c-a278-4d1c177d69f4 tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 200 len: 1308 microversion: 2.1 time: 0.101368 Nov 24 16:09:15.785609 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 328/638] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:15 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:16.181693 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-df5b0021-5317-4eab-96ec-5a37168e95e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:16.182329 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-df5b0021-5317-4eab-96ec-5a37168e95e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:16.188939 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-df5b0021-5317-4eab-96ec-5a37168e95e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:16.189420 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-df5b0021-5317-4eab-96ec-5a37168e95e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:16.190223 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-df5b0021-5317-4eab-96ec-5a37168e95e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:16.190661 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-df5b0021-5317-4eab-96ec-5a37168e95e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:16.367247 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-df5b0021-5317-4eab-96ec-5a37168e95e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:16.376428 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-df5b0021-5317-4eab-96ec-5a37168e95e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:16.378062 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-df5b0021-5317-4eab-96ec-5a37168e95e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:16.380870 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-df5b0021-5317-4eab-96ec-5a37168e95e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1744 microversion: 2.20 time: 0.203000 Nov 24 16:09:16.387928 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 311/639] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:16 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1744 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:16.629173 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-66a38a1f-291e-4aa5-b7e5-413617a5b0ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:16.630009 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-66a38a1f-291e-4aa5-b7e5-413617a5b0ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:16.637389 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-66a38a1f-291e-4aa5-b7e5-413617a5b0ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:16.638262 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-66a38a1f-291e-4aa5-b7e5-413617a5b0ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:16.639270 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-66a38a1f-291e-4aa5-b7e5-413617a5b0ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:16.640966 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-66a38a1f-291e-4aa5-b7e5-413617a5b0ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:16.802615 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cce330f8-9fbe-4247-8255-0db2f7c3585f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:16.803682 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cce330f8-9fbe-4247-8255-0db2f7c3585f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] [instance: c7e069fb-95d8-4964-b82d-ca884fcb2b5e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:16.810098 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cce330f8-9fbe-4247-8255-0db2f7c3585f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:16.810838 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cce330f8-9fbe-4247-8255-0db2f7c3585f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:16.811679 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cce330f8-9fbe-4247-8255-0db2f7c3585f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:16.812117 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cce330f8-9fbe-4247-8255-0db2f7c3585f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:16.821006 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-66a38a1f-291e-4aa5-b7e5-413617a5b0ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:16.829790 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-66a38a1f-291e-4aa5-b7e5-413617a5b0ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.209894 Nov 24 16:09:16.841138 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 329/640] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:16 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:16.842767 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-cce330f8-9fbe-4247-8255-0db2f7c3585f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] HTTP exception thrown: Instance c7e069fb-95d8-4964-b82d-ca884fcb2b5e could not be found. Nov 24 16:09:16.843531 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cce330f8-9fbe-4247-8255-0db2f7c3585f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] Returning 404 to user: Instance c7e069fb-95d8-4964-b82d-ca884fcb2b5e could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:09:16.844414 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cce330f8-9fbe-4247-8255-0db2f7c3585f tempest-AttachVolumeNegativeTest-673256658 tempest-AttachVolumeNegativeTest-673256658-project] 10.222.0.72 "GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e" status: 404 len: 111 microversion: 2.1 time: 0.046376 Nov 24 16:09:16.845149 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 312/641] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:16 2021] GET /compute/v2.1/servers/c7e069fb-95d8-4964-b82d-ca884fcb2b5e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 16:09:17.402153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b229559d-1a83-4bb7-bed8-35cdfb6d266f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:17.403920 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b229559d-1a83-4bb7-bed8-35cdfb6d266f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:17.413870 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b229559d-1a83-4bb7-bed8-35cdfb6d266f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:17.414660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b229559d-1a83-4bb7-bed8-35cdfb6d266f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:17.415732 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b229559d-1a83-4bb7-bed8-35cdfb6d266f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:17.416557 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b229559d-1a83-4bb7-bed8-35cdfb6d266f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:17.623035 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b229559d-1a83-4bb7-bed8-35cdfb6d266f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:17.640529 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b229559d-1a83-4bb7-bed8-35cdfb6d266f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:17.645252 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b229559d-1a83-4bb7-bed8-35cdfb6d266f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:17.647472 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b229559d-1a83-4bb7-bed8-35cdfb6d266f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1739 microversion: 2.20 time: 0.250623 Nov 24 16:09:17.648820 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 330/642] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:17 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:09:17.848331 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7fbbdca3-d6a2-4cc2-84de-1db481e8adc5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:17.849839 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7fbbdca3-d6a2-4cc2-84de-1db481e8adc5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:17.858679 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7fbbdca3-d6a2-4cc2-84de-1db481e8adc5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:17.859365 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7fbbdca3-d6a2-4cc2-84de-1db481e8adc5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:17.860344 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7fbbdca3-d6a2-4cc2-84de-1db481e8adc5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:17.860932 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7fbbdca3-d6a2-4cc2-84de-1db481e8adc5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:18.268326 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7fbbdca3-d6a2-4cc2-84de-1db481e8adc5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:18.304620 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7fbbdca3-d6a2-4cc2-84de-1db481e8adc5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.460294 Nov 24 16:09:18.305758 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 313/643] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:17 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:18.667895 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c215bd77-dc2b-4cad-b679-64c42d261ad2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:18.668805 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c215bd77-dc2b-4cad-b679-64c42d261ad2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:18.686145 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c215bd77-dc2b-4cad-b679-64c42d261ad2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:18.686614 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c215bd77-dc2b-4cad-b679-64c42d261ad2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:18.687677 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c215bd77-dc2b-4cad-b679-64c42d261ad2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:18.688161 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c215bd77-dc2b-4cad-b679-64c42d261ad2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:19.002552 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c215bd77-dc2b-4cad-b679-64c42d261ad2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:19.030417 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c215bd77-dc2b-4cad-b679-64c42d261ad2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:19.033742 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c215bd77-dc2b-4cad-b679-64c42d261ad2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:19.037775 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c215bd77-dc2b-4cad-b679-64c42d261ad2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1739 microversion: 2.20 time: 0.373201 Nov 24 16:09:19.039613 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 331/644] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:18 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1739 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:19.325051 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-678899c2-b005-4104-8c71-4a5eef8c2b0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:19.326211 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-678899c2-b005-4104-8c71-4a5eef8c2b0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:19.336937 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-678899c2-b005-4104-8c71-4a5eef8c2b0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:19.337788 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-678899c2-b005-4104-8c71-4a5eef8c2b0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:19.339069 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-678899c2-b005-4104-8c71-4a5eef8c2b0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:19.339703 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-678899c2-b005-4104-8c71-4a5eef8c2b0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:19.795962 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-678899c2-b005-4104-8c71-4a5eef8c2b0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:19.806804 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-678899c2-b005-4104-8c71-4a5eef8c2b0e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.486677 Nov 24 16:09:19.808677 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 314/645] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:19 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:20.068462 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f969263f-0890-4581-9462-098aa094f0eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:20.069446 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f969263f-0890-4581-9462-098aa094f0eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:20.078724 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f969263f-0890-4581-9462-098aa094f0eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:20.079506 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f969263f-0890-4581-9462-098aa094f0eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:20.080494 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f969263f-0890-4581-9462-098aa094f0eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:20.081122 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f969263f-0890-4581-9462-098aa094f0eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:20.148150 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-bc8f7148-e1fc-4e99-bda7-836f29c613a9 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Action: 'create', calling method: .version_select at 0x7f361aa9f790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-828443657"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:20.385338 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f969263f-0890-4581-9462-098aa094f0eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:20.406844 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f969263f-0890-4581-9462-098aa094f0eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:20.408955 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f969263f-0890-4581-9462-098aa094f0eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:20.411533 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f969263f-0890-4581-9462-098aa094f0eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1739 microversion: 2.20 time: 0.347562 Nov 24 16:09:20.423597 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 315/646] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:20 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1739 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:20.735750 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-bc8f7148-e1fc-4e99-bda7-836f29c613a9 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.820711 Nov 24 16:09:20.737517 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 332/647] 10.222.0.72 () {60 vars in 1154 bytes} [Wed Nov 24 16:09:19 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 823 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 24 16:09:20.750958 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-beb6dac1-65cf-492c-b949-bbcb11bfbe43 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361b3033a0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:20.819184 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-beb6dac1-65cf-492c-b949-bbcb11bfbe43 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621" status: 200 len: 344 microversion: 2.1 time: 0.074442 Nov 24 16:09:20.820311 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 316/648] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:09:20 2021] GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621 => generated 344 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:20.833631 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1f948618-6103-4ca5-b3c7-9da199f85d9e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:20.834152 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1f948618-6103-4ca5-b3c7-9da199f85d9e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:20.841534 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1f948618-6103-4ca5-b3c7-9da199f85d9e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:20.842277 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1f948618-6103-4ca5-b3c7-9da199f85d9e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:20.843270 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1f948618-6103-4ca5-b3c7-9da199f85d9e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:20.843713 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1f948618-6103-4ca5-b3c7-9da199f85d9e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:21.054608 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1f948618-6103-4ca5-b3c7-9da199f85d9e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:21.063781 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1f948618-6103-4ca5-b3c7-9da199f85d9e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.234983 Nov 24 16:09:21.065086 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 333/649] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:20 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:09:21.431714 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-bd858211-32b3-46e5-9fe5-d42a0b14fe33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:21.433046 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-bd858211-32b3-46e5-9fe5-d42a0b14fe33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:21.439897 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bd858211-32b3-46e5-9fe5-d42a0b14fe33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:21.440348 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bd858211-32b3-46e5-9fe5-d42a0b14fe33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:21.441841 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bd858211-32b3-46e5-9fe5-d42a0b14fe33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:21.442481 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-bd858211-32b3-46e5-9fe5-d42a0b14fe33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:21.609365 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bd858211-32b3-46e5-9fe5-d42a0b14fe33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:21.621478 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bd858211-32b3-46e5-9fe5-d42a0b14fe33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:21.623360 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-bd858211-32b3-46e5-9fe5-d42a0b14fe33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:21.624765 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-bd858211-32b3-46e5-9fe5-d42a0b14fe33 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1739 microversion: 2.20 time: 0.197479 Nov 24 16:09:21.625708 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 317/650] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:21 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:21.835585 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fa45691d-6ee8-421f-8efb-bf896d1127af tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361a9661f0>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:21.897634 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fa45691d-6ee8-421f-8efb-bf896d1127af tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621" status: 200 len: 344 microversion: 2.1 time: 0.068344 Nov 24 16:09:21.903830 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 334/651] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:09:21 2021] GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621 => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:22.082457 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dee66559-5d8d-4639-bee3-9fa09a87bae6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:22.083600 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dee66559-5d8d-4639-bee3-9fa09a87bae6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:22.090636 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dee66559-5d8d-4639-bee3-9fa09a87bae6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:22.091382 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dee66559-5d8d-4639-bee3-9fa09a87bae6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:22.092453 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dee66559-5d8d-4639-bee3-9fa09a87bae6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:22.092881 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dee66559-5d8d-4639-bee3-9fa09a87bae6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:22.278653 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dee66559-5d8d-4639-bee3-9fa09a87bae6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:22.294033 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dee66559-5d8d-4639-bee3-9fa09a87bae6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.215156 Nov 24 16:09:22.310093 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 318/652] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:22 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:22.655842 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a8123551-687f-4ca0-a833-9b47c40234f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:22.656173 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a8123551-687f-4ca0-a833-9b47c40234f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:22.663967 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a8123551-687f-4ca0-a833-9b47c40234f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:22.665148 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a8123551-687f-4ca0-a833-9b47c40234f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:22.667136 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a8123551-687f-4ca0-a833-9b47c40234f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:22.668023 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a8123551-687f-4ca0-a833-9b47c40234f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:22.859660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a8123551-687f-4ca0-a833-9b47c40234f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:22.872837 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a8123551-687f-4ca0-a833-9b47c40234f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:22.879805 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a8123551-687f-4ca0-a833-9b47c40234f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:22.881884 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a8123551-687f-4ca0-a833-9b47c40234f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1739 microversion: 2.20 time: 0.230746 Nov 24 16:09:22.882540 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 335/653] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:22 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:22.911724 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-67e06b6e-6bc9-49a4-b7d7-f319dfbb5f72 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361b3033a0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:22.970868 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-67e06b6e-6bc9-49a4-b7d7-f319dfbb5f72 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621" status: 200 len: 344 microversion: 2.1 time: 0.063346 Nov 24 16:09:22.982037 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 319/654] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:09:22 2021] GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621 => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:23.320511 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-41805308-b190-48de-9255-cd4eb423a0ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:23.321706 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-41805308-b190-48de-9255-cd4eb423a0ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:23.328246 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-41805308-b190-48de-9255-cd4eb423a0ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:23.328782 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-41805308-b190-48de-9255-cd4eb423a0ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:23.329840 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-41805308-b190-48de-9255-cd4eb423a0ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:23.330482 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-41805308-b190-48de-9255-cd4eb423a0ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:23.602671 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-41805308-b190-48de-9255-cd4eb423a0ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:23.611990 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-41805308-b190-48de-9255-cd4eb423a0ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.295046 Nov 24 16:09:23.612636 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 336/655] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:23 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:23.900626 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d3751a56-71bb-4741-82ec-0ceb69ea067f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:23.901820 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d3751a56-71bb-4741-82ec-0ceb69ea067f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:23.910366 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3751a56-71bb-4741-82ec-0ceb69ea067f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:23.911185 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3751a56-71bb-4741-82ec-0ceb69ea067f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:23.912072 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3751a56-71bb-4741-82ec-0ceb69ea067f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:23.912833 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3751a56-71bb-4741-82ec-0ceb69ea067f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:23.994038 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4523e38e-456a-42ed-b9a1-55c17439cc0c tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361ac0c040>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:24.095385 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4523e38e-456a-42ed-b9a1-55c17439cc0c tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621" status: 200 len: 344 microversion: 2.1 time: 0.111028 Nov 24 16:09:24.101054 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 337/656] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:09:23 2021] GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621 => generated 344 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:24.120780 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d3751a56-71bb-4741-82ec-0ceb69ea067f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:24.130527 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d3751a56-71bb-4741-82ec-0ceb69ea067f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:24.132663 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d3751a56-71bb-4741-82ec-0ceb69ea067f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:24.134196 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d3751a56-71bb-4741-82ec-0ceb69ea067f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1739 microversion: 2.20 time: 0.237840 Nov 24 16:09:24.135059 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 320/657] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:23 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:24.638382 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ca71e2f0-4778-4817-bae8-860376c5fb2b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:24.639684 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ca71e2f0-4778-4817-bae8-860376c5fb2b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:24.647183 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ca71e2f0-4778-4817-bae8-860376c5fb2b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:24.647919 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ca71e2f0-4778-4817-bae8-860376c5fb2b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:24.648729 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ca71e2f0-4778-4817-bae8-860376c5fb2b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:24.649198 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ca71e2f0-4778-4817-bae8-860376c5fb2b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:24.851213 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-ca71e2f0-4778-4817-bae8-860376c5fb2b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:24.860587 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ca71e2f0-4778-4817-bae8-860376c5fb2b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.228533 Nov 24 16:09:24.862123 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 338/658] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:24 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:25.108131 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-354293fc-b6b1-4e1b-8211-6e6e56837265 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361b3f6af0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:25.156485 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-bcf26e65-787d-481f-9012-eaf216bc8cb0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:25.157314 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-bcf26e65-787d-481f-9012-eaf216bc8cb0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:25.176371 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bcf26e65-787d-481f-9012-eaf216bc8cb0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:25.177095 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bcf26e65-787d-481f-9012-eaf216bc8cb0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:25.178062 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bcf26e65-787d-481f-9012-eaf216bc8cb0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:25.178640 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bcf26e65-787d-481f-9012-eaf216bc8cb0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:25.189594 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-354293fc-b6b1-4e1b-8211-6e6e56837265 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621" status: 200 len: 345 microversion: 2.1 time: 0.085497 Nov 24 16:09:25.190906 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 321/659] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:09:25 2021] GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621 => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:25.203377 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ed1fa8bc-51d0-41ba-84c8-a645a9cbbcd9 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Action: 'create', calling method: .version_select at 0x7f361aa70b80>, body: {"snapshot": {"volume_id": "aa749cb0-7306-4896-859a-063a81883621", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1632631213"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:25.391056 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-bcf26e65-787d-481f-9012-eaf216bc8cb0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:25.401399 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-bcf26e65-787d-481f-9012-eaf216bc8cb0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:25.403326 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-bcf26e65-787d-481f-9012-eaf216bc8cb0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:25.404836 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-bcf26e65-787d-481f-9012-eaf216bc8cb0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1739 microversion: 2.20 time: 0.255788 Nov 24 16:09:25.409090 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 339/660] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:25 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:09:25.434773 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ed1fa8bc-51d0-41ba-84c8-a645a9cbbcd9 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.236263 Nov 24 16:09:25.441623 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 322/661] 10.222.0.72 () {60 vars in 1161 bytes} [Wed Nov 24 16:09:25 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:25.446517 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e37b7df1-bc77-42f0-b168-ccd7ba1cb1d1 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361a8cf1f0>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:25.492151 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e37b7df1-bc77-42f0-b168-ccd7ba1cb1d1 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a" status: 200 len: 287 microversion: 2.1 time: 0.048827 Nov 24 16:09:25.492995 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 340/662] 10.222.0.72 () {58 vars in 1250 bytes} [Wed Nov 24 16:09:25 2021] GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:25.506078 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6715e5bc-86d4-4ce8-936e-53b57e208754 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361aa61c10>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:25.542672 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6715e5bc-86d4-4ce8-936e-53b57e208754 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.041586 Nov 24 16:09:25.543306 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 323/663] 10.222.0.72 () {58 vars in 1139 bytes} [Wed Nov 24 16:09:25 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:25.553612 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e229febf-78f5-4ed5-96fd-f20fd871db39 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361aab4f70>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:25.588702 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e229febf-78f5-4ed5-96fd-f20fd871db39 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a" status: 200 len: 287 microversion: 2.1 time: 0.038750 Nov 24 16:09:25.590345 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 341/664] 10.222.0.72 () {58 vars in 1250 bytes} [Wed Nov 24 16:09:25 2021] GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:25.889121 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-985e0080-c35d-4014-8205-53d68ccb8b67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:25.890177 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-985e0080-c35d-4014-8205-53d68ccb8b67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:25.899597 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-985e0080-c35d-4014-8205-53d68ccb8b67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:25.900573 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-985e0080-c35d-4014-8205-53d68ccb8b67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:25.901459 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-985e0080-c35d-4014-8205-53d68ccb8b67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:25.902360 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-985e0080-c35d-4014-8205-53d68ccb8b67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:26.075448 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-985e0080-c35d-4014-8205-53d68ccb8b67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:26.088269 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-985e0080-c35d-4014-8205-53d68ccb8b67 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.203504 Nov 24 16:09:26.089424 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 324/665] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:25 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:26.424187 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8cdd907c-c565-4d5d-8808-7bfb9189acdd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:26.424893 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8cdd907c-c565-4d5d-8808-7bfb9189acdd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:26.434006 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8cdd907c-c565-4d5d-8808-7bfb9189acdd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:26.434540 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8cdd907c-c565-4d5d-8808-7bfb9189acdd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:26.435523 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8cdd907c-c565-4d5d-8808-7bfb9189acdd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:26.435938 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8cdd907c-c565-4d5d-8808-7bfb9189acdd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:26.602100 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b6a8d033-760c-4d2c-9d15-febe3f8cd8d2 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361aa39040>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:26.666186 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b6a8d033-760c-4d2c-9d15-febe3f8cd8d2 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a" status: 200 len: 287 microversion: 2.1 time: 0.068765 Nov 24 16:09:26.670847 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 325/666] 10.222.0.72 () {58 vars in 1250 bytes} [Wed Nov 24 16:09:26 2021] GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:09:26.674074 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8cdd907c-c565-4d5d-8808-7bfb9189acdd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:26.684343 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8cdd907c-c565-4d5d-8808-7bfb9189acdd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:26.686390 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8cdd907c-c565-4d5d-8808-7bfb9189acdd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:26.687807 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8cdd907c-c565-4d5d-8808-7bfb9189acdd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1739 microversion: 2.20 time: 0.267394 Nov 24 16:09:26.688548 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 342/667] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:26 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:09:27.108595 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8c4e43d1-02a3-4cb7-b2b4-3a9b067ff07a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:27.110531 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8c4e43d1-02a3-4cb7-b2b4-3a9b067ff07a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:27.118104 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c4e43d1-02a3-4cb7-b2b4-3a9b067ff07a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:27.118987 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c4e43d1-02a3-4cb7-b2b4-3a9b067ff07a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:27.119988 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c4e43d1-02a3-4cb7-b2b4-3a9b067ff07a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:27.120604 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c4e43d1-02a3-4cb7-b2b4-3a9b067ff07a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:27.299440 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8c4e43d1-02a3-4cb7-b2b4-3a9b067ff07a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:27.316993 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8c4e43d1-02a3-4cb7-b2b4-3a9b067ff07a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.212902 Nov 24 16:09:27.317651 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 326/668] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:27 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:27.678349 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-51285c16-128b-436f-b687-a6367f741253 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361aab49d0>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:27.709454 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-51285c16-128b-436f-b687-a6367f741253 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a" status: 200 len: 287 microversion: 2.1 time: 0.035221 Nov 24 16:09:27.710107 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 343/669] 10.222.0.72 () {58 vars in 1250 bytes} [Wed Nov 24 16:09:27 2021] GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:27.712757 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-055bbbe4-a8f6-40b3-a78d-5a7cf5221658 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:27.713584 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-055bbbe4-a8f6-40b3-a78d-5a7cf5221658 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:27.719937 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-055bbbe4-a8f6-40b3-a78d-5a7cf5221658 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:27.723015 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-055bbbe4-a8f6-40b3-a78d-5a7cf5221658 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:27.723943 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-055bbbe4-a8f6-40b3-a78d-5a7cf5221658 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:27.724449 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-055bbbe4-a8f6-40b3-a78d-5a7cf5221658 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:27.857181 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-055bbbe4-a8f6-40b3-a78d-5a7cf5221658 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:27.866016 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-055bbbe4-a8f6-40b3-a78d-5a7cf5221658 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:27.867435 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-055bbbe4-a8f6-40b3-a78d-5a7cf5221658 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:27.868585 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-055bbbe4-a8f6-40b3-a78d-5a7cf5221658 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1739 microversion: 2.20 time: 0.161012 Nov 24 16:09:27.869179 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 327/670] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:27 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:28.334558 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-37957667-32fa-4628-bde6-0da27b77b376 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:28.335088 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-37957667-32fa-4628-bde6-0da27b77b376 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:28.341215 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-37957667-32fa-4628-bde6-0da27b77b376 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:28.341668 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-37957667-32fa-4628-bde6-0da27b77b376 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:28.342461 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-37957667-32fa-4628-bde6-0da27b77b376 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:28.342897 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-37957667-32fa-4628-bde6-0da27b77b376 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:28.478841 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-37957667-32fa-4628-bde6-0da27b77b376 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:28.486598 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-37957667-32fa-4628-bde6-0da27b77b376 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.156653 Nov 24 16:09:28.487269 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 344/671] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:28 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:28.721010 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-aa7ac68e-0962-419b-aead-dd33f6abd72c tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361b30b310>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:28.749594 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-aa7ac68e-0962-419b-aead-dd33f6abd72c tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a" status: 200 len: 287 microversion: 2.1 time: 0.032140 Nov 24 16:09:28.750465 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 328/672] 10.222.0.72 () {58 vars in 1250 bytes} [Wed Nov 24 16:09:28 2021] GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:28.886191 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-11c9b31b-3eea-47f0-a1de-ac754a9667fd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:28.886801 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-11c9b31b-3eea-47f0-a1de-ac754a9667fd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:28.893184 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-11c9b31b-3eea-47f0-a1de-ac754a9667fd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:28.893737 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-11c9b31b-3eea-47f0-a1de-ac754a9667fd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:28.894522 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-11c9b31b-3eea-47f0-a1de-ac754a9667fd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:28.894954 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-11c9b31b-3eea-47f0-a1de-ac754a9667fd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:29.024993 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-11c9b31b-3eea-47f0-a1de-ac754a9667fd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:29.032579 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-11c9b31b-3eea-47f0-a1de-ac754a9667fd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:29.034182 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-11c9b31b-3eea-47f0-a1de-ac754a9667fd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:29.035428 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-11c9b31b-3eea-47f0-a1de-ac754a9667fd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1739 microversion: 2.20 time: 0.152971 Nov 24 16:09:29.035988 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 345/673] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:28 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:29.504738 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cd49eabb-472d-4a12-9430-baae941be1e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:29.505384 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cd49eabb-472d-4a12-9430-baae941be1e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:29.511606 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd49eabb-472d-4a12-9430-baae941be1e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:29.512057 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd49eabb-472d-4a12-9430-baae941be1e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:29.512861 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd49eabb-472d-4a12-9430-baae941be1e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:29.513357 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd49eabb-472d-4a12-9430-baae941be1e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:29.648765 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cd49eabb-472d-4a12-9430-baae941be1e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:29.656760 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cd49eabb-472d-4a12-9430-baae941be1e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.156855 Nov 24 16:09:29.657370 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 329/674] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:29 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:29.761200 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-650290b4-0dc2-48ff-a0a0-7d4c1a1f4989 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361a8e0790>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:29.789456 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-650290b4-0dc2-48ff-a0a0-7d4c1a1f4989 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a" status: 200 len: 288 microversion: 2.1 time: 0.031778 Nov 24 16:09:29.790021 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 346/675] 10.222.0.72 () {58 vars in 1250 bytes} [Wed Nov 24 16:09:29 2021] GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a => generated 288 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:29.800814 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f3ab8351-c9ad-4f2f-8a72-100c82378ae2 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361b3033a0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:29.861694 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f3ab8351-c9ad-4f2f-8a72-100c82378ae2 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "DELETE /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a" status: 202 len: 0 microversion: 2.1 time: 0.065418 Nov 24 16:09:29.862316 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 330/676] 10.222.0.72 () {58 vars in 1253 bytes} [Wed Nov 24 16:09:29 2021] DELETE /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:09:29.870475 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-650492e6-62b1-4730-9f6d-ee286cc3cfed tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361a8cf8b0>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:29.899711 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-650492e6-62b1-4730-9f6d-ee286cc3cfed tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a" status: 200 len: 287 microversion: 2.1 time: 0.032889 Nov 24 16:09:29.900602 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 347/677] 10.222.0.72 () {58 vars in 1250 bytes} [Wed Nov 24 16:09:29 2021] GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:09:30.053395 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f3388827-a8db-42a5-9c08-1274fb08c63b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:30.054008 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f3388827-a8db-42a5-9c08-1274fb08c63b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:30.059772 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f3388827-a8db-42a5-9c08-1274fb08c63b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:30.060223 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f3388827-a8db-42a5-9c08-1274fb08c63b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:30.061006 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f3388827-a8db-42a5-9c08-1274fb08c63b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:30.061465 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f3388827-a8db-42a5-9c08-1274fb08c63b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:30.198354 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f3388827-a8db-42a5-9c08-1274fb08c63b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:30.207480 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f3388827-a8db-42a5-9c08-1274fb08c63b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:30.208999 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f3388827-a8db-42a5-9c08-1274fb08c63b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:30.210192 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f3388827-a8db-42a5-9c08-1274fb08c63b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1739 microversion: 2.20 time: 0.160682 Nov 24 16:09:30.210799 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 331/678] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:30 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:30.674497 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-cf4449e3-7a8d-43a4-a295-aa3c7bbdb32e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:30.675860 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-cf4449e3-7a8d-43a4-a295-aa3c7bbdb32e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:30.682624 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cf4449e3-7a8d-43a4-a295-aa3c7bbdb32e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:30.683054 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cf4449e3-7a8d-43a4-a295-aa3c7bbdb32e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:30.684075 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cf4449e3-7a8d-43a4-a295-aa3c7bbdb32e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:30.684488 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cf4449e3-7a8d-43a4-a295-aa3c7bbdb32e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:30.852400 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-cf4449e3-7a8d-43a4-a295-aa3c7bbdb32e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:30.861632 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-cf4449e3-7a8d-43a4-a295-aa3c7bbdb32e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.190309 Nov 24 16:09:30.861632 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 348/679] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:30 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:30.913644 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-11acd0b6-7499-42b7-8461-58248319fffe tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361b30b700>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:30.952320 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-11acd0b6-7499-42b7-8461-58248319fffe tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] HTTP exception thrown: Snapshot 8193c0f1-21d9-45d5-9927-2194418ad18a could not be found. Nov 24 16:09:30.952966 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-11acd0b6-7499-42b7-8461-58248319fffe tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Returning 404 to user: Snapshot 8193c0f1-21d9-45d5-9927-2194418ad18a could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:09:30.953846 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-11acd0b6-7499-42b7-8461-58248319fffe tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a" status: 404 len: 111 microversion: 2.1 time: 0.045673 Nov 24 16:09:30.954408 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 332/680] 10.222.0.72 () {58 vars in 1250 bytes} [Wed Nov 24 16:09:30 2021] GET /compute/v2.1/os-snapshots/8193c0f1-21d9-45d5-9927-2194418ad18a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:09:30.963386 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-eab76dba-be39-46c1-9229-71834f38757c tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361aa9f820>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:31.036413 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-eab76dba-be39-46c1-9229-71834f38757c tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621" status: 202 len: 0 microversion: 2.1 time: 0.076443 Nov 24 16:09:31.040146 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 349/681] 10.222.0.72 () {58 vars in 1247 bytes} [Wed Nov 24 16:09:30 2021] DELETE /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:09:31.045804 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b8f459b9-5883-46b6-b20e-0867b9b8acb8 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361aa39430>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:31.104658 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b8f459b9-5883-46b6-b20e-0867b9b8acb8 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621" status: 200 len: 344 microversion: 2.1 time: 0.062842 Nov 24 16:09:31.106016 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 333/682] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:09:31 2021] GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:09:31.228929 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-652e0461-2825-4ff3-993d-506ae2af3741 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:31.229604 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-652e0461-2825-4ff3-993d-506ae2af3741 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:31.236240 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-652e0461-2825-4ff3-993d-506ae2af3741 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:31.236717 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-652e0461-2825-4ff3-993d-506ae2af3741 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:31.237974 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-652e0461-2825-4ff3-993d-506ae2af3741 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:31.238657 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-652e0461-2825-4ff3-993d-506ae2af3741 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:31.390269 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-652e0461-2825-4ff3-993d-506ae2af3741 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:31.399785 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-652e0461-2825-4ff3-993d-506ae2af3741 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:31.401381 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-652e0461-2825-4ff3-993d-506ae2af3741 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:31.402484 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-652e0461-2825-4ff3-993d-506ae2af3741 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1721 microversion: 2.20 time: 0.177364 Nov 24 16:09:31.403050 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 350/683] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:31 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:31.882302 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d67d39ac-c92d-46d7-af17-5e798903a7e1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:31.882911 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d67d39ac-c92d-46d7-af17-5e798903a7e1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:31.890722 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d67d39ac-c92d-46d7-af17-5e798903a7e1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:31.890722 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d67d39ac-c92d-46d7-af17-5e798903a7e1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:31.890722 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d67d39ac-c92d-46d7-af17-5e798903a7e1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:31.891147 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d67d39ac-c92d-46d7-af17-5e798903a7e1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:32.049302 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d67d39ac-c92d-46d7-af17-5e798903a7e1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:32.060679 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d67d39ac-c92d-46d7-af17-5e798903a7e1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.182785 Nov 24 16:09:32.061298 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 334/684] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:31 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:32.119401 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c40434e6-104d-4289-bc15-02e81d9f7079 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361a9483a0>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:32.151614 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-c40434e6-104d-4289-bc15-02e81d9f7079 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] HTTP exception thrown: Volume aa749cb0-7306-4896-859a-063a81883621 could not be found. Nov 24 16:09:32.152214 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c40434e6-104d-4289-bc15-02e81d9f7079 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Returning 404 to user: Volume aa749cb0-7306-4896-859a-063a81883621 could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:09:32.153062 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c40434e6-104d-4289-bc15-02e81d9f7079 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621" status: 404 len: 109 microversion: 2.1 time: 0.037350 Nov 24 16:09:32.153623 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 351/685] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:09:32 2021] GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:09:32.168938 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d814088e-732b-4993-b557-5a79f8e485e2 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361aa39d30>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:32.199282 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-d814088e-732b-4993-b557-5a79f8e485e2 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] HTTP exception thrown: Volume aa749cb0-7306-4896-859a-063a81883621 could not be found. Nov 24 16:09:32.199887 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d814088e-732b-4993-b557-5a79f8e485e2 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Returning 404 to user: Volume aa749cb0-7306-4896-859a-063a81883621 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:09:32.200713 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d814088e-732b-4993-b557-5a79f8e485e2 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621" status: 404 len: 109 microversion: 2.1 time: 0.035697 Nov 24 16:09:32.201296 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 335/686] 10.222.0.72 () {58 vars in 1247 bytes} [Wed Nov 24 16:09:32 2021] DELETE /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:09:32.209756 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-987ef819-b1b9-48c1-88bc-b3c7d129b7e3 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Calling method '.version_select at 0x7f361a8cf310>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:32.242627 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-987ef819-b1b9-48c1-88bc-b3c7d129b7e3 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] HTTP exception thrown: Volume aa749cb0-7306-4896-859a-063a81883621 could not be found. Nov 24 16:09:32.243229 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-987ef819-b1b9-48c1-88bc-b3c7d129b7e3 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] Returning 404 to user: Volume aa749cb0-7306-4896-859a-063a81883621 could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:09:32.244058 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-987ef819-b1b9-48c1-88bc-b3c7d129b7e3 tempest-VolumesSnapshotsTestJSON-1903038655 tempest-VolumesSnapshotsTestJSON-1903038655-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621" status: 404 len: 109 microversion: 2.1 time: 0.038713 Nov 24 16:09:32.244595 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 352/687] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:09:32 2021] GET /compute/v2.1/os-volumes/aa749cb0-7306-4896-859a-063a81883621 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 16:09:32.424060 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9addcacc-e089-468b-9669-d5a6694794f2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:32.424960 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9addcacc-e089-468b-9669-d5a6694794f2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:32.431691 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9addcacc-e089-468b-9669-d5a6694794f2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:32.432151 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9addcacc-e089-468b-9669-d5a6694794f2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:32.432980 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9addcacc-e089-468b-9669-d5a6694794f2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:32.433446 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9addcacc-e089-468b-9669-d5a6694794f2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:32.595704 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9addcacc-e089-468b-9669-d5a6694794f2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:32.604331 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9addcacc-e089-468b-9669-d5a6694794f2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:32.606120 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-9addcacc-e089-468b-9669-d5a6694794f2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:32.607514 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9addcacc-e089-468b-9669-d5a6694794f2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1721 microversion: 2.20 time: 0.187440 Nov 24 16:09:32.608062 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 336/688] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:32 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:33.079259 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-88d0c666-8e6b-49b1-8ac5-6b81f3c8079f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:33.079874 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-88d0c666-8e6b-49b1-8ac5-6b81f3c8079f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:33.086346 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88d0c666-8e6b-49b1-8ac5-6b81f3c8079f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:33.086802 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88d0c666-8e6b-49b1-8ac5-6b81f3c8079f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:33.087595 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88d0c666-8e6b-49b1-8ac5-6b81f3c8079f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:33.088344 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88d0c666-8e6b-49b1-8ac5-6b81f3c8079f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:33.257910 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-88d0c666-8e6b-49b1-8ac5-6b81f3c8079f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:33.266538 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-88d0c666-8e6b-49b1-8ac5-6b81f3c8079f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1722 microversion: 2.1 time: 0.191197 Nov 24 16:09:33.267204 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 353/689] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:33 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:33.626635 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-26711582-5214-42db-8254-8d3b17dde322 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:33.627237 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-26711582-5214-42db-8254-8d3b17dde322 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:33.634330 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26711582-5214-42db-8254-8d3b17dde322 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:33.634711 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26711582-5214-42db-8254-8d3b17dde322 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:33.635502 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26711582-5214-42db-8254-8d3b17dde322 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:33.635936 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26711582-5214-42db-8254-8d3b17dde322 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:33.781908 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-26711582-5214-42db-8254-8d3b17dde322 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:33.791230 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-26711582-5214-42db-8254-8d3b17dde322 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:33.792735 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-26711582-5214-42db-8254-8d3b17dde322 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:33.794091 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-26711582-5214-42db-8254-8d3b17dde322 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1664 microversion: 2.20 time: 0.171572 Nov 24 16:09:33.797362 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 337/690] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:33 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:33.811824 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-26f4d8de-e400-463d-b051-c935bf02c44a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db69556b-99cd-402f-ab21-c8aee84f024b"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:33.812947 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-26f4d8de-e400-463d-b051-c935bf02c44a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:33.819545 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-26f4d8de-e400-463d-b051-c935bf02c44a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:33.819996 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-26f4d8de-e400-463d-b051-c935bf02c44a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:33.820783 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-26f4d8de-e400-463d-b051-c935bf02c44a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:33.821437 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-26f4d8de-e400-463d-b051-c935bf02c44a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:34.008510 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-332b9c0d-6204-4e39-a56f-1224c1e87e88 req-66373f46-d6cd-4b6c-a190-40258820980c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-unplugged", "status": "completed", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:34.010728 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:09:34.010728 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:09:34.026011 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-332b9c0d-6204-4e39-a56f-1224c1e87e88 req-66373f46-d6cd-4b6c-a190-40258820980c service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:34.027378 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-332b9c0d-6204-4e39-a56f-1224c1e87e88 req-66373f46-d6cd-4b6c-a190-40258820980c service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:34.044796 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.compute.server_external_events [req-332b9c0d-6204-4e39-a56f-1224c1e87e88 req-66373f46-d6cd-4b6c-a190-40258820980c service nova] Unable to find a host for instance 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6. Dropping event network-vif-unplugged {{(pid=116304) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 24 16:09:34.045884 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-332b9c0d-6204-4e39-a56f-1224c1e87e88 req-66373f46-d6cd-4b6c-a190-40258820980c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043452 Nov 24 16:09:34.047132 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 338/691] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:09:34 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 24 16:09:34.170639 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-26f4d8de-e400-463d-b051-c935bf02c44a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.362565 Nov 24 16:09:34.171342 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 354/692] 10.222.0.72 () {62 vars in 1363 bytes} [Wed Nov 24 16:09:33 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/os-volume_attachments => generated 188 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:09:34.286547 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d2562d1c-4ad7-4a44-bfb9-72d7fc0893b8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:34.287154 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d2562d1c-4ad7-4a44-bfb9-72d7fc0893b8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:34.296710 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ecbcd4b4-50b5-4139-8751-8a9beed48515 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:34.298070 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ecbcd4b4-50b5-4139-8751-8a9beed48515 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:34.309792 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d2562d1c-4ad7-4a44-bfb9-72d7fc0893b8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:34.310234 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d2562d1c-4ad7-4a44-bfb9-72d7fc0893b8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:34.313555 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ecbcd4b4-50b5-4139-8751-8a9beed48515 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:34.314878 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d2562d1c-4ad7-4a44-bfb9-72d7fc0893b8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:34.316249 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ecbcd4b4-50b5-4139-8751-8a9beed48515 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:34.317218 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ecbcd4b4-50b5-4139-8751-8a9beed48515 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:34.317648 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ecbcd4b4-50b5-4139-8751-8a9beed48515 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:34.318508 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d2562d1c-4ad7-4a44-bfb9-72d7fc0893b8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:34.433855 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ecbcd4b4-50b5-4139-8751-8a9beed48515 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action" status: 202 len: 0 microversion: 2.20 time: 0.141630 Nov 24 16:09:34.434462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 355/693] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:09:34 2021] POST /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 24 16:09:34.443262 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1d8bf4a1-bc16-47b1-b545-f0e5881fb819 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:34.444013 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1d8bf4a1-bc16-47b1-b545-f0e5881fb819 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:34.451808 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1d8bf4a1-bc16-47b1-b545-f0e5881fb819 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:34.452189 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1d8bf4a1-bc16-47b1-b545-f0e5881fb819 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:34.452978 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1d8bf4a1-bc16-47b1-b545-f0e5881fb819 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:34.453433 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1d8bf4a1-bc16-47b1-b545-f0e5881fb819 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:34.482739 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d2562d1c-4ad7-4a44-bfb9-72d7fc0893b8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:34.492702 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d2562d1c-4ad7-4a44-bfb9-72d7fc0893b8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1699 microversion: 2.1 time: 0.210267 Nov 24 16:09:34.493772 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 339/694] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:34 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1699 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:34.513734 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a37c3c07-f80b-41d2-97da-6d3c40c95528 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:09:34.523267 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a37c3c07-f80b-41d2-97da-6d3c40c95528 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:34.524032 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a37c3c07-f80b-41d2-97da-6d3c40c95528 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:34.601433 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a37c3c07-f80b-41d2-97da-6d3c40c95528 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Going to try to start instance {{(pid=116304) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 24 16:09:34.646680 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1d8bf4a1-bc16-47b1-b545-f0e5881fb819 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:34.656917 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1d8bf4a1-bc16-47b1-b545-f0e5881fb819 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:34.658897 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1d8bf4a1-bc16-47b1-b545-f0e5881fb819 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:34.660398 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1d8bf4a1-bc16-47b1-b545-f0e5881fb819 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1750 microversion: 2.20 time: 0.221776 Nov 24 16:09:34.661208 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 356/695] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:34 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1750 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:09:34.671833 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a37c3c07-f80b-41d2-97da-6d3c40c95528 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 202 len: 0 microversion: 2.1 time: 0.156148 Nov 24 16:09:34.671833 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 340/696] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:09:34 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:09:34.675689 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8ef3574d-380c-40b4-8ef5-e2edf63337fb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:34.683324 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8ef3574d-380c-40b4-8ef5-e2edf63337fb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:34.691314 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ef3574d-380c-40b4-8ef5-e2edf63337fb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:34.692045 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ef3574d-380c-40b4-8ef5-e2edf63337fb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:34.692918 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ef3574d-380c-40b4-8ef5-e2edf63337fb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:34.693679 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8ef3574d-380c-40b4-8ef5-e2edf63337fb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:34.954445 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8ef3574d-380c-40b4-8ef5-e2edf63337fb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:34.966690 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8ef3574d-380c-40b4-8ef5-e2edf63337fb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1708 microversion: 2.1 time: 0.295259 Nov 24 16:09:34.967978 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 341/697] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:34 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1708 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:09:35.680416 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e1b7d519-3f17-4d20-87cd-80ba2716c5b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:35.681384 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e1b7d519-3f17-4d20-87cd-80ba2716c5b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:35.687826 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e1b7d519-3f17-4d20-87cd-80ba2716c5b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:35.688599 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e1b7d519-3f17-4d20-87cd-80ba2716c5b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:35.689421 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e1b7d519-3f17-4d20-87cd-80ba2716c5b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:35.690297 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e1b7d519-3f17-4d20-87cd-80ba2716c5b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:35.893789 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e1b7d519-3f17-4d20-87cd-80ba2716c5b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:35.902963 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e1b7d519-3f17-4d20-87cd-80ba2716c5b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:35.905275 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e1b7d519-3f17-4d20-87cd-80ba2716c5b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:35.906907 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e1b7d519-3f17-4d20-87cd-80ba2716c5b9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1752 microversion: 2.20 time: 0.231026 Nov 24 16:09:35.908014 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 357/698] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:35 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1752 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:35.984948 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b91f89b9-e780-49d5-a5e1-dbe0008d77c0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:35.985777 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b91f89b9-e780-49d5-a5e1-dbe0008d77c0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:35.992419 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b91f89b9-e780-49d5-a5e1-dbe0008d77c0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:35.992875 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b91f89b9-e780-49d5-a5e1-dbe0008d77c0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:35.993714 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b91f89b9-e780-49d5-a5e1-dbe0008d77c0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:35.994158 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b91f89b9-e780-49d5-a5e1-dbe0008d77c0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:36.146735 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b91f89b9-e780-49d5-a5e1-dbe0008d77c0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:36.154817 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b91f89b9-e780-49d5-a5e1-dbe0008d77c0 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1708 microversion: 2.1 time: 0.173475 Nov 24 16:09:36.155401 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 342/699] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:35 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1708 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:09:36.929803 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-655d488f-b68e-4e1a-8e6d-2ba07794e1bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:36.930472 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-655d488f-b68e-4e1a-8e6d-2ba07794e1bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:36.936624 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-655d488f-b68e-4e1a-8e6d-2ba07794e1bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:36.937168 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-655d488f-b68e-4e1a-8e6d-2ba07794e1bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:36.938012 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-655d488f-b68e-4e1a-8e6d-2ba07794e1bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:36.938508 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-655d488f-b68e-4e1a-8e6d-2ba07794e1bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:37.081280 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-655d488f-b68e-4e1a-8e6d-2ba07794e1bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:37.090198 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-655d488f-b68e-4e1a-8e6d-2ba07794e1bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:37.091675 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-655d488f-b68e-4e1a-8e6d-2ba07794e1bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:37.093063 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-655d488f-b68e-4e1a-8e6d-2ba07794e1bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.167319 Nov 24 16:09:37.093617 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 358/700] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:36 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:37.172048 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a42b5636-c701-494e-afc0-1bb26680d20a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:37.173098 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a42b5636-c701-494e-afc0-1bb26680d20a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:37.186358 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a42b5636-c701-494e-afc0-1bb26680d20a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:37.187061 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a42b5636-c701-494e-afc0-1bb26680d20a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:37.188321 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a42b5636-c701-494e-afc0-1bb26680d20a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:37.188913 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a42b5636-c701-494e-afc0-1bb26680d20a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:37.412499 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a42b5636-c701-494e-afc0-1bb26680d20a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:37.421043 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a42b5636-c701-494e-afc0-1bb26680d20a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1712 microversion: 2.1 time: 0.252874 Nov 24 16:09:37.421624 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 343/701] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:09:37 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1712 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:09:38.113944 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0c1741f1-4ded-4436-a456-561777adace7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:38.114653 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0c1741f1-4ded-4436-a456-561777adace7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:38.120712 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0c1741f1-4ded-4436-a456-561777adace7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:38.121194 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0c1741f1-4ded-4436-a456-561777adace7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:38.121964 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0c1741f1-4ded-4436-a456-561777adace7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:38.122392 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0c1741f1-4ded-4436-a456-561777adace7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:38.281837 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-0c1741f1-4ded-4436-a456-561777adace7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:38.290694 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-0c1741f1-4ded-4436-a456-561777adace7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:38.292172 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-0c1741f1-4ded-4436-a456-561777adace7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:38.293476 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0c1741f1-4ded-4436-a456-561777adace7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.184388 Nov 24 16:09:38.294033 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 359/702] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:38 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:39.318284 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-01618f82-2487-4e4c-be1d-c2f95ba3010a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:39.318895 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-01618f82-2487-4e4c-be1d-c2f95ba3010a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:39.326243 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-01618f82-2487-4e4c-be1d-c2f95ba3010a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:39.326690 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-01618f82-2487-4e4c-be1d-c2f95ba3010a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:39.327486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-01618f82-2487-4e4c-be1d-c2f95ba3010a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:39.327922 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-01618f82-2487-4e4c-be1d-c2f95ba3010a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:39.475155 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-01618f82-2487-4e4c-be1d-c2f95ba3010a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:39.483483 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-01618f82-2487-4e4c-be1d-c2f95ba3010a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:39.485433 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-01618f82-2487-4e4c-be1d-c2f95ba3010a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:39.486874 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-01618f82-2487-4e4c-be1d-c2f95ba3010a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.172530 Nov 24 16:09:39.487855 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 344/703] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:39 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:40.506844 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d255e362-ec5e-448a-95df-f109cd805eb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:40.507499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d255e362-ec5e-448a-95df-f109cd805eb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:40.514013 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d255e362-ec5e-448a-95df-f109cd805eb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:40.514456 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d255e362-ec5e-448a-95df-f109cd805eb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:40.515267 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d255e362-ec5e-448a-95df-f109cd805eb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:40.515700 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d255e362-ec5e-448a-95df-f109cd805eb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:40.680617 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d255e362-ec5e-448a-95df-f109cd805eb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:40.690422 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d255e362-ec5e-448a-95df-f109cd805eb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:40.692509 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d255e362-ec5e-448a-95df-f109cd805eb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:40.693751 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d255e362-ec5e-448a-95df-f109cd805eb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.191805 Nov 24 16:09:40.694308 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 360/704] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:40 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:41.713268 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-df37d9b1-5c37-4d53-9f87-766dcc67dd8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:41.713946 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-df37d9b1-5c37-4d53-9f87-766dcc67dd8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:41.730045 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-df37d9b1-5c37-4d53-9f87-766dcc67dd8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:41.731062 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-df37d9b1-5c37-4d53-9f87-766dcc67dd8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:41.732056 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-df37d9b1-5c37-4d53-9f87-766dcc67dd8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:41.732815 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-df37d9b1-5c37-4d53-9f87-766dcc67dd8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:41.898665 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-df37d9b1-5c37-4d53-9f87-766dcc67dd8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:41.907889 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-df37d9b1-5c37-4d53-9f87-766dcc67dd8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:41.909915 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-df37d9b1-5c37-4d53-9f87-766dcc67dd8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:41.911335 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-df37d9b1-5c37-4d53-9f87-766dcc67dd8d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.202011 Nov 24 16:09:41.911896 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 345/705] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:41 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:42.932891 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c64677a2-564f-4488-a399-d1f0b937bf0b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:42.933416 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c64677a2-564f-4488-a399-d1f0b937bf0b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:42.940351 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c64677a2-564f-4488-a399-d1f0b937bf0b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:42.941534 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c64677a2-564f-4488-a399-d1f0b937bf0b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:42.942857 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c64677a2-564f-4488-a399-d1f0b937bf0b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:42.943486 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c64677a2-564f-4488-a399-d1f0b937bf0b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:43.099418 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c64677a2-564f-4488-a399-d1f0b937bf0b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:43.108914 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c64677a2-564f-4488-a399-d1f0b937bf0b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:43.110776 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c64677a2-564f-4488-a399-d1f0b937bf0b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:43.112926 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c64677a2-564f-4488-a399-d1f0b937bf0b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.186030 Nov 24 16:09:43.124072 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 361/706] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:42 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:44.138017 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c6637a1c-a9db-4453-bb3e-a2d429893b7d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:44.138690 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c6637a1c-a9db-4453-bb3e-a2d429893b7d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:44.151147 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6637a1c-a9db-4453-bb3e-a2d429893b7d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:44.151508 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6637a1c-a9db-4453-bb3e-a2d429893b7d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:44.152307 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6637a1c-a9db-4453-bb3e-a2d429893b7d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:44.152928 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6637a1c-a9db-4453-bb3e-a2d429893b7d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:44.390826 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c6637a1c-a9db-4453-bb3e-a2d429893b7d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:44.402407 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c6637a1c-a9db-4453-bb3e-a2d429893b7d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:44.404342 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c6637a1c-a9db-4453-bb3e-a2d429893b7d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:44.406002 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c6637a1c-a9db-4453-bb3e-a2d429893b7d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.271790 Nov 24 16:09:44.406827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 346/707] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:44 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:45.427929 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e64ed595-8052-41dc-a57b-118979af9925 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:45.429171 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e64ed595-8052-41dc-a57b-118979af9925 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:45.439731 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e64ed595-8052-41dc-a57b-118979af9925 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:45.440343 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e64ed595-8052-41dc-a57b-118979af9925 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:45.441893 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e64ed595-8052-41dc-a57b-118979af9925 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:45.442308 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e64ed595-8052-41dc-a57b-118979af9925 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:45.683774 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e64ed595-8052-41dc-a57b-118979af9925 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:45.694255 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e64ed595-8052-41dc-a57b-118979af9925 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:45.696693 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e64ed595-8052-41dc-a57b-118979af9925 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:45.698811 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e64ed595-8052-41dc-a57b-118979af9925 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.275844 Nov 24 16:09:45.699374 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 362/708] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:45 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:46.719900 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8e96ca67-574e-4c4d-8d4c-755a4dd6e1da tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:46.720821 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8e96ca67-574e-4c4d-8d4c-755a4dd6e1da tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:46.729055 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8e96ca67-574e-4c4d-8d4c-755a4dd6e1da tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:46.729861 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8e96ca67-574e-4c4d-8d4c-755a4dd6e1da tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:46.730871 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8e96ca67-574e-4c4d-8d4c-755a4dd6e1da tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:46.731533 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8e96ca67-574e-4c4d-8d4c-755a4dd6e1da tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:46.889586 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8e96ca67-574e-4c4d-8d4c-755a4dd6e1da tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:46.904011 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8e96ca67-574e-4c4d-8d4c-755a4dd6e1da tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:46.906263 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8e96ca67-574e-4c4d-8d4c-755a4dd6e1da tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:46.907919 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8e96ca67-574e-4c4d-8d4c-755a4dd6e1da tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.192788 Nov 24 16:09:46.908901 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 347/709] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:46 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:47.927282 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a7822783-74b1-4cff-ae52-1dfb9440c6b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:47.927894 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a7822783-74b1-4cff-ae52-1dfb9440c6b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:47.934316 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a7822783-74b1-4cff-ae52-1dfb9440c6b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:47.934755 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a7822783-74b1-4cff-ae52-1dfb9440c6b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:47.935835 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a7822783-74b1-4cff-ae52-1dfb9440c6b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:47.936395 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a7822783-74b1-4cff-ae52-1dfb9440c6b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:48.076492 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a7822783-74b1-4cff-ae52-1dfb9440c6b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:48.088045 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a7822783-74b1-4cff-ae52-1dfb9440c6b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:48.089584 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a7822783-74b1-4cff-ae52-1dfb9440c6b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:48.090837 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a7822783-74b1-4cff-ae52-1dfb9440c6b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.167616 Nov 24 16:09:48.091406 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 363/710] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:47 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:49.109593 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5efaf29d-046a-4441-aaae-b543247205a4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:49.110218 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5efaf29d-046a-4441-aaae-b543247205a4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:49.117539 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5efaf29d-046a-4441-aaae-b543247205a4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:49.117987 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5efaf29d-046a-4441-aaae-b543247205a4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:49.118768 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5efaf29d-046a-4441-aaae-b543247205a4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:49.119203 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5efaf29d-046a-4441-aaae-b543247205a4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:49.256293 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5efaf29d-046a-4441-aaae-b543247205a4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:49.264951 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5efaf29d-046a-4441-aaae-b543247205a4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:49.266500 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5efaf29d-046a-4441-aaae-b543247205a4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:49.268238 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5efaf29d-046a-4441-aaae-b543247205a4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.162121 Nov 24 16:09:49.271554 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 348/711] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:49 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:50.287062 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-803cdf32-6e56-4735-9ca9-a4d8571d7601 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:50.287668 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-803cdf32-6e56-4735-9ca9-a4d8571d7601 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:50.294090 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-803cdf32-6e56-4735-9ca9-a4d8571d7601 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:50.294533 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-803cdf32-6e56-4735-9ca9-a4d8571d7601 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:50.295305 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-803cdf32-6e56-4735-9ca9-a4d8571d7601 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:50.295735 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-803cdf32-6e56-4735-9ca9-a4d8571d7601 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:50.426448 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-803cdf32-6e56-4735-9ca9-a4d8571d7601 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:50.434546 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-803cdf32-6e56-4735-9ca9-a4d8571d7601 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:50.436038 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-803cdf32-6e56-4735-9ca9-a4d8571d7601 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:50.437205 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-803cdf32-6e56-4735-9ca9-a4d8571d7601 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.154628 Nov 24 16:09:50.437758 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 364/712] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:50 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:51.455924 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-76dbb7e5-abe4-47ae-be2d-e0c0518ef204 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:51.456627 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-76dbb7e5-abe4-47ae-be2d-e0c0518ef204 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:51.463160 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-76dbb7e5-abe4-47ae-be2d-e0c0518ef204 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:51.463668 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-76dbb7e5-abe4-47ae-be2d-e0c0518ef204 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:51.464407 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-76dbb7e5-abe4-47ae-be2d-e0c0518ef204 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:51.464850 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-76dbb7e5-abe4-47ae-be2d-e0c0518ef204 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:51.605148 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-76dbb7e5-abe4-47ae-be2d-e0c0518ef204 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:51.614807 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-76dbb7e5-abe4-47ae-be2d-e0c0518ef204 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:51.616307 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-76dbb7e5-abe4-47ae-be2d-e0c0518ef204 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:51.617504 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-76dbb7e5-abe4-47ae-be2d-e0c0518ef204 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.165704 Nov 24 16:09:51.618069 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 349/713] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:51 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:52.636292 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1b899b62-f67f-4f1d-bff5-9e12d90f878f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:52.636907 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1b899b62-f67f-4f1d-bff5-9e12d90f878f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:52.643902 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1b899b62-f67f-4f1d-bff5-9e12d90f878f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:52.644347 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1b899b62-f67f-4f1d-bff5-9e12d90f878f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:52.645153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1b899b62-f67f-4f1d-bff5-9e12d90f878f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:52.645590 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1b899b62-f67f-4f1d-bff5-9e12d90f878f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:52.777842 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1b899b62-f67f-4f1d-bff5-9e12d90f878f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:52.786571 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1b899b62-f67f-4f1d-bff5-9e12d90f878f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:52.788264 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1b899b62-f67f-4f1d-bff5-9e12d90f878f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:52.789459 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1b899b62-f67f-4f1d-bff5-9e12d90f878f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.156880 Nov 24 16:09:52.790013 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 365/714] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:52 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:53.807274 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fd75d8da-68c8-4720-99cf-e5bc1d566bf1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:53.807868 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fd75d8da-68c8-4720-99cf-e5bc1d566bf1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:53.814363 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd75d8da-68c8-4720-99cf-e5bc1d566bf1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:53.814928 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd75d8da-68c8-4720-99cf-e5bc1d566bf1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:53.815718 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd75d8da-68c8-4720-99cf-e5bc1d566bf1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:53.816159 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fd75d8da-68c8-4720-99cf-e5bc1d566bf1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:53.947841 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fd75d8da-68c8-4720-99cf-e5bc1d566bf1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:53.956868 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fd75d8da-68c8-4720-99cf-e5bc1d566bf1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:53.958400 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fd75d8da-68c8-4720-99cf-e5bc1d566bf1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:53.959584 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fd75d8da-68c8-4720-99cf-e5bc1d566bf1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.156062 Nov 24 16:09:53.960149 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 350/715] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:53 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:54.977101 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-bd97bb30-2101-441a-ac5f-137d2cb3eb17 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:54.977706 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-bd97bb30-2101-441a-ac5f-137d2cb3eb17 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:54.984259 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bd97bb30-2101-441a-ac5f-137d2cb3eb17 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:54.984708 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bd97bb30-2101-441a-ac5f-137d2cb3eb17 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:54.985527 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bd97bb30-2101-441a-ac5f-137d2cb3eb17 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:54.986581 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bd97bb30-2101-441a-ac5f-137d2cb3eb17 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:55.121391 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-bd97bb30-2101-441a-ac5f-137d2cb3eb17 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:55.129973 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-bd97bb30-2101-441a-ac5f-137d2cb3eb17 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:55.131464 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-bd97bb30-2101-441a-ac5f-137d2cb3eb17 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:55.132807 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-bd97bb30-2101-441a-ac5f-137d2cb3eb17 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.159366 Nov 24 16:09:55.133566 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 366/716] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:54 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:56.152389 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-57f10e22-b770-48da-a808-83cbb2cafa58 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:56.152993 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-57f10e22-b770-48da-a808-83cbb2cafa58 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:56.159430 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-57f10e22-b770-48da-a808-83cbb2cafa58 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:56.159878 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-57f10e22-b770-48da-a808-83cbb2cafa58 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:56.160659 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-57f10e22-b770-48da-a808-83cbb2cafa58 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:56.161132 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-57f10e22-b770-48da-a808-83cbb2cafa58 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:56.298085 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-57f10e22-b770-48da-a808-83cbb2cafa58 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:56.308067 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-57f10e22-b770-48da-a808-83cbb2cafa58 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:56.309653 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-57f10e22-b770-48da-a808-83cbb2cafa58 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:56.310803 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-57f10e22-b770-48da-a808-83cbb2cafa58 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.162158 Nov 24 16:09:56.311367 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 351/717] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:56 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:57.328582 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e5ddabe4-94f7-4513-95e7-fd12430d6d67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:57.329229 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e5ddabe4-94f7-4513-95e7-fd12430d6d67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:57.335927 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e5ddabe4-94f7-4513-95e7-fd12430d6d67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:57.336369 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e5ddabe4-94f7-4513-95e7-fd12430d6d67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:57.337178 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e5ddabe4-94f7-4513-95e7-fd12430d6d67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:57.337614 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e5ddabe4-94f7-4513-95e7-fd12430d6d67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:57.472721 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e5ddabe4-94f7-4513-95e7-fd12430d6d67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:57.488443 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e5ddabe4-94f7-4513-95e7-fd12430d6d67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:57.490264 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e5ddabe4-94f7-4513-95e7-fd12430d6d67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:57.491471 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e5ddabe4-94f7-4513-95e7-fd12430d6d67 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.166542 Nov 24 16:09:57.492043 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 367/718] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:57 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:58.510555 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e4a6461f-162b-44a2-abd4-69906bfe9a22 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:58.511163 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e4a6461f-162b-44a2-abd4-69906bfe9a22 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:58.518299 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e4a6461f-162b-44a2-abd4-69906bfe9a22 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:58.518903 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e4a6461f-162b-44a2-abd4-69906bfe9a22 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:58.519701 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e4a6461f-162b-44a2-abd4-69906bfe9a22 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:58.520142 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e4a6461f-162b-44a2-abd4-69906bfe9a22 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:58.652419 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e4a6461f-162b-44a2-abd4-69906bfe9a22 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:58.661928 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e4a6461f-162b-44a2-abd4-69906bfe9a22 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:58.663665 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e4a6461f-162b-44a2-abd4-69906bfe9a22 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:58.664914 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e4a6461f-162b-44a2-abd4-69906bfe9a22 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.158095 Nov 24 16:09:58.665537 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 352/719] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:58 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:09:59.682711 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8a963636-671f-44da-a5ea-f779c0241699 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:09:59.683308 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8a963636-671f-44da-a5ea-f779c0241699 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:09:59.690220 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8a963636-671f-44da-a5ea-f779c0241699 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:59.690666 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8a963636-671f-44da-a5ea-f779c0241699 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:59.691453 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8a963636-671f-44da-a5ea-f779c0241699 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:09:59.691891 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8a963636-671f-44da-a5ea-f779c0241699 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:09:59.823952 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8a963636-671f-44da-a5ea-f779c0241699 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:59.832948 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8a963636-671f-44da-a5ea-f779c0241699 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:59.834494 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8a963636-671f-44da-a5ea-f779c0241699 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:09:59.835684 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8a963636-671f-44da-a5ea-f779c0241699 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.156767 Nov 24 16:09:59.836239 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 368/720] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:09:59 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:00.853999 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-88bcb4d1-30c1-4dda-8713-3eead2204ee2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:00.854634 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-88bcb4d1-30c1-4dda-8713-3eead2204ee2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:00.861184 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88bcb4d1-30c1-4dda-8713-3eead2204ee2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:00.861708 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88bcb4d1-30c1-4dda-8713-3eead2204ee2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:00.862475 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88bcb4d1-30c1-4dda-8713-3eead2204ee2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:00.862906 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88bcb4d1-30c1-4dda-8713-3eead2204ee2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:00.996769 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-88bcb4d1-30c1-4dda-8713-3eead2204ee2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:01.005989 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-88bcb4d1-30c1-4dda-8713-3eead2204ee2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:01.007493 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-88bcb4d1-30c1-4dda-8713-3eead2204ee2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:01.008673 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-88bcb4d1-30c1-4dda-8713-3eead2204ee2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.158385 Nov 24 16:10:01.009263 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 353/721] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:00 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:02.027468 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0f609981-54e9-4317-b87a-26414ab1c94e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:02.028106 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0f609981-54e9-4317-b87a-26414ab1c94e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:02.035456 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0f609981-54e9-4317-b87a-26414ab1c94e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:02.035911 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0f609981-54e9-4317-b87a-26414ab1c94e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:02.036690 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0f609981-54e9-4317-b87a-26414ab1c94e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:02.037157 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0f609981-54e9-4317-b87a-26414ab1c94e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:02.169430 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-0f609981-54e9-4317-b87a-26414ab1c94e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:02.178811 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-0f609981-54e9-4317-b87a-26414ab1c94e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:02.180346 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-0f609981-54e9-4317-b87a-26414ab1c94e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:02.181554 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0f609981-54e9-4317-b87a-26414ab1c94e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.157832 Nov 24 16:10:02.182122 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 369/722] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:02 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:03.199443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ab77d496-adf6-4b7f-a5f5-0ae9079e8bed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:03.200060 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ab77d496-adf6-4b7f-a5f5-0ae9079e8bed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:03.206567 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ab77d496-adf6-4b7f-a5f5-0ae9079e8bed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:03.207047 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ab77d496-adf6-4b7f-a5f5-0ae9079e8bed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:03.207827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ab77d496-adf6-4b7f-a5f5-0ae9079e8bed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:03.208261 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ab77d496-adf6-4b7f-a5f5-0ae9079e8bed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:03.339001 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ab77d496-adf6-4b7f-a5f5-0ae9079e8bed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:03.348123 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ab77d496-adf6-4b7f-a5f5-0ae9079e8bed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:03.349679 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ab77d496-adf6-4b7f-a5f5-0ae9079e8bed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:03.350833 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ab77d496-adf6-4b7f-a5f5-0ae9079e8bed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.155075 Nov 24 16:10:03.351398 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 354/723] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:03 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:04.369177 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9a2c7751-773c-4f78-b7a1-4f1b996b9121 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:04.369783 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9a2c7751-773c-4f78-b7a1-4f1b996b9121 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:04.376423 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9a2c7751-773c-4f78-b7a1-4f1b996b9121 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:04.377499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9a2c7751-773c-4f78-b7a1-4f1b996b9121 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:04.378281 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9a2c7751-773c-4f78-b7a1-4f1b996b9121 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:04.378718 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9a2c7751-773c-4f78-b7a1-4f1b996b9121 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:04.508045 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9a2c7751-773c-4f78-b7a1-4f1b996b9121 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:04.516187 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9a2c7751-773c-4f78-b7a1-4f1b996b9121 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:04.518261 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9a2c7751-773c-4f78-b7a1-4f1b996b9121 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:04.518924 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9a2c7751-773c-4f78-b7a1-4f1b996b9121 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.153542 Nov 24 16:10:04.519485 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 370/724] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:04 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:05.537900 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ced3571b-2a97-4610-8efe-ff35660a804e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:05.538428 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ced3571b-2a97-4610-8efe-ff35660a804e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:05.546439 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ced3571b-2a97-4610-8efe-ff35660a804e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:05.546800 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ced3571b-2a97-4610-8efe-ff35660a804e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:05.547543 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ced3571b-2a97-4610-8efe-ff35660a804e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:05.547975 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ced3571b-2a97-4610-8efe-ff35660a804e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:05.697483 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ced3571b-2a97-4610-8efe-ff35660a804e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:05.706243 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ced3571b-2a97-4610-8efe-ff35660a804e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:05.707736 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ced3571b-2a97-4610-8efe-ff35660a804e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:05.708856 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ced3571b-2a97-4610-8efe-ff35660a804e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.176014 Nov 24 16:10:05.709481 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 355/725] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:05 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:06.727181 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9bb6d7d7-7605-4013-95df-abbb985a0ddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:06.727969 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9bb6d7d7-7605-4013-95df-abbb985a0ddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:06.735082 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9bb6d7d7-7605-4013-95df-abbb985a0ddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:06.735747 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9bb6d7d7-7605-4013-95df-abbb985a0ddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:06.736725 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9bb6d7d7-7605-4013-95df-abbb985a0ddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:06.737386 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9bb6d7d7-7605-4013-95df-abbb985a0ddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:06.888326 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9bb6d7d7-7605-4013-95df-abbb985a0ddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:06.900897 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9bb6d7d7-7605-4013-95df-abbb985a0ddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:06.903436 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9bb6d7d7-7605-4013-95df-abbb985a0ddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:06.904991 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9bb6d7d7-7605-4013-95df-abbb985a0ddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.181613 Nov 24 16:10:06.906177 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 371/726] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:06 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:07.936682 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-26c38695-6b13-44bd-ac71-69cc49c11d88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:07.937478 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-26c38695-6b13-44bd-ac71-69cc49c11d88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:07.945213 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26c38695-6b13-44bd-ac71-69cc49c11d88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:07.945616 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26c38695-6b13-44bd-ac71-69cc49c11d88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:07.946424 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26c38695-6b13-44bd-ac71-69cc49c11d88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:07.946865 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-26c38695-6b13-44bd-ac71-69cc49c11d88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:08.127707 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-26c38695-6b13-44bd-ac71-69cc49c11d88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:08.136605 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-26c38695-6b13-44bd-ac71-69cc49c11d88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:08.138205 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-26c38695-6b13-44bd-ac71-69cc49c11d88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:08.139369 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-26c38695-6b13-44bd-ac71-69cc49c11d88 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.206524 Nov 24 16:10:08.139934 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 356/727] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:07 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:09.157733 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3c00ad37-8efa-4811-a532-d1f9dee80d35 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:09.158596 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3c00ad37-8efa-4811-a532-d1f9dee80d35 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:09.165230 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3c00ad37-8efa-4811-a532-d1f9dee80d35 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:09.165603 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3c00ad37-8efa-4811-a532-d1f9dee80d35 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:09.166687 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3c00ad37-8efa-4811-a532-d1f9dee80d35 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:09.167124 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3c00ad37-8efa-4811-a532-d1f9dee80d35 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:09.508649 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3c00ad37-8efa-4811-a532-d1f9dee80d35 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:09.518039 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3c00ad37-8efa-4811-a532-d1f9dee80d35 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:09.519717 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3c00ad37-8efa-4811-a532-d1f9dee80d35 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:09.521015 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3c00ad37-8efa-4811-a532-d1f9dee80d35 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.367182 Nov 24 16:10:09.521802 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 372/728] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:09 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:10.539897 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-17ea653b-bc53-4183-bba0-509be95d5f96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:10.540601 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-17ea653b-bc53-4183-bba0-509be95d5f96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:10.547261 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-17ea653b-bc53-4183-bba0-509be95d5f96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:10.547706 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-17ea653b-bc53-4183-bba0-509be95d5f96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:10.548808 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-17ea653b-bc53-4183-bba0-509be95d5f96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:10.549422 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-17ea653b-bc53-4183-bba0-509be95d5f96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:10.859167 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-17ea653b-bc53-4183-bba0-509be95d5f96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:10.868427 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-17ea653b-bc53-4183-bba0-509be95d5f96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:10.869931 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-17ea653b-bc53-4183-bba0-509be95d5f96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:10.871072 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-17ea653b-bc53-4183-bba0-509be95d5f96 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.335209 Nov 24 16:10:10.871649 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 357/729] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:10 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:11.891087 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7ec647de-d838-442e-bd0f-df124708dde0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:11.891668 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7ec647de-d838-442e-bd0f-df124708dde0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:11.898923 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7ec647de-d838-442e-bd0f-df124708dde0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:11.899365 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7ec647de-d838-442e-bd0f-df124708dde0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:11.900153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7ec647de-d838-442e-bd0f-df124708dde0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:11.900583 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7ec647de-d838-442e-bd0f-df124708dde0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:12.037502 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7ec647de-d838-442e-bd0f-df124708dde0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:12.045919 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7ec647de-d838-442e-bd0f-df124708dde0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:12.047416 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7ec647de-d838-442e-bd0f-df124708dde0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:12.049292 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7ec647de-d838-442e-bd0f-df124708dde0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.161924 Nov 24 16:10:12.049860 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 373/730] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:11 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:13.067548 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3278e1af-024d-44c9-a2f3-9a07204c9d9d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:13.068229 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3278e1af-024d-44c9-a2f3-9a07204c9d9d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:13.075417 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3278e1af-024d-44c9-a2f3-9a07204c9d9d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:13.075870 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3278e1af-024d-44c9-a2f3-9a07204c9d9d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:13.076683 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3278e1af-024d-44c9-a2f3-9a07204c9d9d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:13.077156 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3278e1af-024d-44c9-a2f3-9a07204c9d9d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:13.223551 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3278e1af-024d-44c9-a2f3-9a07204c9d9d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:13.232388 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3278e1af-024d-44c9-a2f3-9a07204c9d9d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:13.233953 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3278e1af-024d-44c9-a2f3-9a07204c9d9d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:13.235130 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3278e1af-024d-44c9-a2f3-9a07204c9d9d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.172327 Nov 24 16:10:13.235753 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 358/731] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:13 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:14.254526 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4cea1b01-cffe-400c-b3a0-d2e61981fa4d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:14.255099 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4cea1b01-cffe-400c-b3a0-d2e61981fa4d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:14.260978 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4cea1b01-cffe-400c-b3a0-d2e61981fa4d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:14.261460 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4cea1b01-cffe-400c-b3a0-d2e61981fa4d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:14.262251 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4cea1b01-cffe-400c-b3a0-d2e61981fa4d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:14.262681 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4cea1b01-cffe-400c-b3a0-d2e61981fa4d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:14.519207 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4cea1b01-cffe-400c-b3a0-d2e61981fa4d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:14.528116 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4cea1b01-cffe-400c-b3a0-d2e61981fa4d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:14.529634 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4cea1b01-cffe-400c-b3a0-d2e61981fa4d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:14.530805 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4cea1b01-cffe-400c-b3a0-d2e61981fa4d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.281211 Nov 24 16:10:14.531369 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 374/732] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:14 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:15.549842 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0e5fa31d-5907-4821-876d-c8e8325ddddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:15.550583 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0e5fa31d-5907-4821-876d-c8e8325ddddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:15.557110 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0e5fa31d-5907-4821-876d-c8e8325ddddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:15.557565 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0e5fa31d-5907-4821-876d-c8e8325ddddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:15.558370 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0e5fa31d-5907-4821-876d-c8e8325ddddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:15.558808 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0e5fa31d-5907-4821-876d-c8e8325ddddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:15.703221 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0e5fa31d-5907-4821-876d-c8e8325ddddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:15.713140 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0e5fa31d-5907-4821-876d-c8e8325ddddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:15.714638 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0e5fa31d-5907-4821-876d-c8e8325ddddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:15.715790 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0e5fa31d-5907-4821-876d-c8e8325ddddf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.169941 Nov 24 16:10:15.716373 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 359/733] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:15 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:16.734405 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-bbe445f3-5302-4c14-a99e-d84dff33c26f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:16.735045 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-bbe445f3-5302-4c14-a99e-d84dff33c26f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:16.741765 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bbe445f3-5302-4c14-a99e-d84dff33c26f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:16.742213 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bbe445f3-5302-4c14-a99e-d84dff33c26f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:16.743007 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bbe445f3-5302-4c14-a99e-d84dff33c26f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:16.743437 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bbe445f3-5302-4c14-a99e-d84dff33c26f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:16.899983 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-bbe445f3-5302-4c14-a99e-d84dff33c26f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:16.909877 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-bbe445f3-5302-4c14-a99e-d84dff33c26f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:16.911366 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-bbe445f3-5302-4c14-a99e-d84dff33c26f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:16.912533 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-bbe445f3-5302-4c14-a99e-d84dff33c26f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.181846 Nov 24 16:10:16.913111 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 375/734] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:16 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:17.932637 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1e065723-c065-44a5-bf66-2b58f7a05811 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:17.933323 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1e065723-c065-44a5-bf66-2b58f7a05811 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:17.940717 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1e065723-c065-44a5-bf66-2b58f7a05811 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:17.941245 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1e065723-c065-44a5-bf66-2b58f7a05811 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:17.942077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1e065723-c065-44a5-bf66-2b58f7a05811 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:17.942588 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1e065723-c065-44a5-bf66-2b58f7a05811 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:18.318519 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-de3637b6-91a4-4d43-87c4-5bcbc84680de req-302d122d-86bb-4a11-b206-7cef5617bcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-plugged", "status": "completed", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:10:18.321757 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:10:18.321757 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:10:18.333108 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-de3637b6-91a4-4d43-87c4-5bcbc84680de req-302d122d-86bb-4a11-b206-7cef5617bcd8 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:18.333797 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-de3637b6-91a4-4d43-87c4-5bcbc84680de req-302d122d-86bb-4a11-b206-7cef5617bcd8 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:18.352155 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-de3637b6-91a4-4d43-87c4-5bcbc84680de req-302d122d-86bb-4a11-b206-7cef5617bcd8 service nova] Creating event network-vif-plugged:0cc6f513-6305-463b-bb1d-17ec8928f67c for instance 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 on hv-cinder-81899 Nov 24 16:10:18.358757 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-de3637b6-91a4-4d43-87c4-5bcbc84680de req-302d122d-86bb-4a11-b206-7cef5617bcd8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045207 Nov 24 16:10:18.371140 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 376/735] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:10:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:10:18.427594 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1e065723-c065-44a5-bf66-2b58f7a05811 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:18.437594 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1e065723-c065-44a5-bf66-2b58f7a05811 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:18.439571 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1e065723-c065-44a5-bf66-2b58f7a05811 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:18.440864 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1e065723-c065-44a5-bf66-2b58f7a05811 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.513492 Nov 24 16:10:18.441483 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 360/736] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:17 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:19.462022 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-06981f7a-a591-42e7-8b03-bebca49f96b7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:19.463376 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-06981f7a-a591-42e7-8b03-bebca49f96b7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:19.467237 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:10:19.468019 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: Wed Nov 24 16:10:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:10:19.471055 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-06981f7a-a591-42e7-8b03-bebca49f96b7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:19.471506 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-06981f7a-a591-42e7-8b03-bebca49f96b7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:19.472540 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-06981f7a-a591-42e7-8b03-bebca49f96b7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:19.472985 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-06981f7a-a591-42e7-8b03-bebca49f96b7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:19.647200 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-06981f7a-a591-42e7-8b03-bebca49f96b7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:19.658304 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-06981f7a-a591-42e7-8b03-bebca49f96b7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:19.659953 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-06981f7a-a591-42e7-8b03-bebca49f96b7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:19.661581 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-06981f7a-a591-42e7-8b03-bebca49f96b7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.204353 Nov 24 16:10:19.662233 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 377/737] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:19 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:20.692422 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-38748da7-a35b-493a-b269-536c56b57589 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:20.693751 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-38748da7-a35b-493a-b269-536c56b57589 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:20.700894 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-38748da7-a35b-493a-b269-536c56b57589 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:20.701388 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-38748da7-a35b-493a-b269-536c56b57589 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:20.702192 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-38748da7-a35b-493a-b269-536c56b57589 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:20.702827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-38748da7-a35b-493a-b269-536c56b57589 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:20.896040 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-38748da7-a35b-493a-b269-536c56b57589 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:20.906194 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-38748da7-a35b-493a-b269-536c56b57589 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:20.909771 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-38748da7-a35b-493a-b269-536c56b57589 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:20.911189 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-38748da7-a35b-493a-b269-536c56b57589 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1808 microversion: 2.20 time: 0.223075 Nov 24 16:10:20.911971 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 361/738] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:20 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:21.930474 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-003922af-5223-427f-9abd-e7a2f9690f3d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:21.931077 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-003922af-5223-427f-9abd-e7a2f9690f3d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:21.937586 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-003922af-5223-427f-9abd-e7a2f9690f3d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:21.938110 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-003922af-5223-427f-9abd-e7a2f9690f3d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:21.938904 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-003922af-5223-427f-9abd-e7a2f9690f3d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:21.939325 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-003922af-5223-427f-9abd-e7a2f9690f3d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:22.098972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-003922af-5223-427f-9abd-e7a2f9690f3d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:22.109188 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-003922af-5223-427f-9abd-e7a2f9690f3d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:22.111288 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-003922af-5223-427f-9abd-e7a2f9690f3d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:22.112377 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-003922af-5223-427f-9abd-e7a2f9690f3d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1795 microversion: 2.20 time: 0.186220 Nov 24 16:10:22.112960 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 378/739] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:10:21 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1795 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:10:22.161893 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1257288994", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "networks": [{"uuid": "0f425afc-3f71-4bdb-94b6-fb87f034ecf4"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:10:22.227358 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] validate_networks() for [('0f425afc-3f71-4bdb-94b6-fb87f034ecf4', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:10:22.665709 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:10:22.666151 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:10:22.666685 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:10:22.667244 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:10:22.667728 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:10:22.677743 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:22.678193 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:22.679016 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:22.679453 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:22.698374 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Getting quotas for project 342ef6b52f7f4b9a87df95d6eaaad436. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:10:22.703033 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Getting quotas for user 10dd3ee140864d3ead94c10cea52c5e4 and project 342ef6b52f7f4b9a87df95d6eaaad436. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:10:22.716687 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:10:22.719142 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:10:22.771167 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6dc9ea3b-75dc-48eb-a693-6daed5a9cf5a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612843 Nov 24 16:10:22.772094 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 362/740] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:10:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:10:22.783482 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6d852e0c-2c4b-4d13-96c1-cdc2dfd0e175 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:22.784545 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6d852e0c-2c4b-4d13-96c1-cdc2dfd0e175 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:22.852820 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6d852e0c-2c4b-4d13-96c1-cdc2dfd0e175 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:22.864680 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6d852e0c-2c4b-4d13-96c1-cdc2dfd0e175 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1214 microversion: 2.1 time: 0.085137 Nov 24 16:10:22.866338 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 379/741] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:22 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:23.883569 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c6e6a2ff-d321-4415-9c7f-48d5995267d7 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:23.884179 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c6e6a2ff-d321-4415-9c7f-48d5995267d7 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:23.891828 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6e6a2ff-d321-4415-9c7f-48d5995267d7 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:23.892275 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6e6a2ff-d321-4415-9c7f-48d5995267d7 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:23.893133 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6e6a2ff-d321-4415-9c7f-48d5995267d7 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:23.893597 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6e6a2ff-d321-4415-9c7f-48d5995267d7 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:23.958545 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c6e6a2ff-d321-4415-9c7f-48d5995267d7 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:23.966310 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c6e6a2ff-d321-4415-9c7f-48d5995267d7 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1266 microversion: 2.1 time: 0.086833 Nov 24 16:10:23.967385 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 363/742] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:23 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:10:24.983674 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7eb50fdd-8663-4f37-8781-f2bdc145f497 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:24.984294 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7eb50fdd-8663-4f37-8781-f2bdc145f497 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:24.991561 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7eb50fdd-8663-4f37-8781-f2bdc145f497 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:24.992023 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7eb50fdd-8663-4f37-8781-f2bdc145f497 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:24.992911 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7eb50fdd-8663-4f37-8781-f2bdc145f497 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:24.993379 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7eb50fdd-8663-4f37-8781-f2bdc145f497 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:25.171237 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7eb50fdd-8663-4f37-8781-f2bdc145f497 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:25.185438 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7eb50fdd-8663-4f37-8781-f2bdc145f497 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1314 microversion: 2.1 time: 0.204916 Nov 24 16:10:25.186558 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 380/743] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:24 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:25.772750 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-9295eb76-aa3f-46d8-8264-ded6eee1af97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c7fc3d1-a0d1-43e5-8986-d780108ce97b", "tag": "0ef17b69-6b2d-4dcb-8260-0e3639cb1149"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:10:25.777733 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:10:25.777733 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:10:25.790190 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-9295eb76-aa3f-46d8-8264-ded6eee1af97 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:25.791364 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-9295eb76-aa3f-46d8-8264-ded6eee1af97 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:25.820748 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-9295eb76-aa3f-46d8-8264-ded6eee1af97 service nova] Creating event network-changed:0ef17b69-6b2d-4dcb-8260-0e3639cb1149 for instance 9c7fc3d1-a0d1-43e5-8986-d780108ce97b on hv-cinder-81899 Nov 24 16:10:25.829056 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-183a66ea-6138-4b64-8e04-a738fd29f6a8 req-9295eb76-aa3f-46d8-8264-ded6eee1af97 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066045 Nov 24 16:10:25.830024 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 364/744] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:10:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:10:26.208931 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b24fa51d-c8f3-42f7-85ee-d563dfcdeae8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:26.210260 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b24fa51d-c8f3-42f7-85ee-d563dfcdeae8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:26.222812 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b24fa51d-c8f3-42f7-85ee-d563dfcdeae8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:26.223605 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b24fa51d-c8f3-42f7-85ee-d563dfcdeae8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:26.225284 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b24fa51d-c8f3-42f7-85ee-d563dfcdeae8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:26.226386 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b24fa51d-c8f3-42f7-85ee-d563dfcdeae8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:26.392472 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b24fa51d-c8f3-42f7-85ee-d563dfcdeae8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:26.402157 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b24fa51d-c8f3-42f7-85ee-d563dfcdeae8 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1314 microversion: 2.1 time: 0.201322 Nov 24 16:10:26.402752 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 381/745] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:26 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:27.420349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0aeccdbf-da11-4f63-81bd-743869ba595a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:27.421060 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0aeccdbf-da11-4f63-81bd-743869ba595a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:27.428597 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0aeccdbf-da11-4f63-81bd-743869ba595a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:27.429072 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0aeccdbf-da11-4f63-81bd-743869ba595a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:27.429901 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0aeccdbf-da11-4f63-81bd-743869ba595a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:27.430338 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0aeccdbf-da11-4f63-81bd-743869ba595a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:27.565125 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0aeccdbf-da11-4f63-81bd-743869ba595a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:27.572349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0aeccdbf-da11-4f63-81bd-743869ba595a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1314 microversion: 2.1 time: 0.155979 Nov 24 16:10:27.572916 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 365/746] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:27 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:28.589584 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5b2a9044-89de-4b16-95e7-613abde0cd1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:28.590160 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5b2a9044-89de-4b16-95e7-613abde0cd1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:28.597731 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5b2a9044-89de-4b16-95e7-613abde0cd1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:28.598178 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5b2a9044-89de-4b16-95e7-613abde0cd1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:28.598971 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5b2a9044-89de-4b16-95e7-613abde0cd1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:28.599405 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5b2a9044-89de-4b16-95e7-613abde0cd1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:28.734463 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-5b2a9044-89de-4b16-95e7-613abde0cd1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:28.742405 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5b2a9044-89de-4b16-95e7-613abde0cd1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1314 microversion: 2.1 time: 0.156563 Nov 24 16:10:28.742982 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 382/747] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:28 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:29.759919 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2b0029fb-a912-4d5f-9ef4-19a117edd46f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:29.760658 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2b0029fb-a912-4d5f-9ef4-19a117edd46f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:29.768629 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2b0029fb-a912-4d5f-9ef4-19a117edd46f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:29.769112 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2b0029fb-a912-4d5f-9ef4-19a117edd46f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:29.769919 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2b0029fb-a912-4d5f-9ef4-19a117edd46f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:29.770355 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2b0029fb-a912-4d5f-9ef4-19a117edd46f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:29.908814 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2b0029fb-a912-4d5f-9ef4-19a117edd46f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:29.916094 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2b0029fb-a912-4d5f-9ef4-19a117edd46f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1314 microversion: 2.1 time: 0.160123 Nov 24 16:10:29.916666 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 366/748] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:29 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:30.932124 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e29455ea-2f96-43ca-a3d8-72912a174c91 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:30.932841 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e29455ea-2f96-43ca-a3d8-72912a174c91 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:30.941660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e29455ea-2f96-43ca-a3d8-72912a174c91 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:30.942105 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e29455ea-2f96-43ca-a3d8-72912a174c91 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:30.942902 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e29455ea-2f96-43ca-a3d8-72912a174c91 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:30.943327 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e29455ea-2f96-43ca-a3d8-72912a174c91 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:31.084448 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e29455ea-2f96-43ca-a3d8-72912a174c91 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:31.091932 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e29455ea-2f96-43ca-a3d8-72912a174c91 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1314 microversion: 2.1 time: 0.163456 Nov 24 16:10:31.092491 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 383/749] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:30 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:32.109278 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-39ede1c5-9fd8-46e6-a724-5f223165df34 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:32.110644 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-39ede1c5-9fd8-46e6-a724-5f223165df34 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:32.116922 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-39ede1c5-9fd8-46e6-a724-5f223165df34 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:32.117404 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-39ede1c5-9fd8-46e6-a724-5f223165df34 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:32.118189 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-39ede1c5-9fd8-46e6-a724-5f223165df34 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:32.118624 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-39ede1c5-9fd8-46e6-a724-5f223165df34 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:32.255241 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-39ede1c5-9fd8-46e6-a724-5f223165df34 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:32.262392 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-39ede1c5-9fd8-46e6-a724-5f223165df34 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1314 microversion: 2.1 time: 0.156723 Nov 24 16:10:32.262981 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 367/750] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:32 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:32.325744 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-a2839c2f-66d8-4d41-aa44-ecee88fa4c67 req-5ebb2a13-fbfa-4427-88c8-eedd627b7155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7fc3d1-a0d1-43e5-8986-d780108ce97b", "name": "network-vif-plugged", "status": "completed", "tag": "0ef17b69-6b2d-4dcb-8260-0e3639cb1149"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:10:32.327283 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:10:32.327283 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:10:32.335596 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-a2839c2f-66d8-4d41-aa44-ecee88fa4c67 req-5ebb2a13-fbfa-4427-88c8-eedd627b7155 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:32.336316 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-a2839c2f-66d8-4d41-aa44-ecee88fa4c67 req-5ebb2a13-fbfa-4427-88c8-eedd627b7155 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:32.347821 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-a2839c2f-66d8-4d41-aa44-ecee88fa4c67 req-5ebb2a13-fbfa-4427-88c8-eedd627b7155 service nova] Creating event network-vif-plugged:0ef17b69-6b2d-4dcb-8260-0e3639cb1149 for instance 9c7fc3d1-a0d1-43e5-8986-d780108ce97b on hv-cinder-81899 Nov 24 16:10:32.352983 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-a2839c2f-66d8-4d41-aa44-ecee88fa4c67 req-5ebb2a13-fbfa-4427-88c8-eedd627b7155 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030964 Nov 24 16:10:32.353810 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 384/751] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:10:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:10:33.278459 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3792ecda-153b-4de6-bf7b-cdd92587e0a1 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:33.279061 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3792ecda-153b-4de6-bf7b-cdd92587e0a1 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:33.285905 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3792ecda-153b-4de6-bf7b-cdd92587e0a1 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:33.286348 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3792ecda-153b-4de6-bf7b-cdd92587e0a1 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:33.287162 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3792ecda-153b-4de6-bf7b-cdd92587e0a1 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:33.287601 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3792ecda-153b-4de6-bf7b-cdd92587e0a1 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:33.422583 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3792ecda-153b-4de6-bf7b-cdd92587e0a1 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:33.430531 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3792ecda-153b-4de6-bf7b-cdd92587e0a1 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1314 microversion: 2.1 time: 0.155657 Nov 24 16:10:33.431131 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 368/752] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:33 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:34.448688 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c58a4c18-6d12-494c-a5e8-06dfbad88a1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:34.449411 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c58a4c18-6d12-494c-a5e8-06dfbad88a1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:34.456621 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c58a4c18-6d12-494c-a5e8-06dfbad88a1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:34.457421 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c58a4c18-6d12-494c-a5e8-06dfbad88a1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:34.458230 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c58a4c18-6d12-494c-a5e8-06dfbad88a1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:34.458769 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c58a4c18-6d12-494c-a5e8-06dfbad88a1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:34.620074 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c58a4c18-6d12-494c-a5e8-06dfbad88a1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:34.630387 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c58a4c18-6d12-494c-a5e8-06dfbad88a1e tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1314 microversion: 2.1 time: 0.186170 Nov 24 16:10:34.631029 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 385/753] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:34 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:35.650878 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-64c1c516-540e-4bbc-9553-fcf8c353def4 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:35.651413 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-64c1c516-540e-4bbc-9553-fcf8c353def4 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:35.658992 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64c1c516-540e-4bbc-9553-fcf8c353def4 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:35.659436 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64c1c516-540e-4bbc-9553-fcf8c353def4 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:35.660245 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64c1c516-540e-4bbc-9553-fcf8c353def4 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:35.660676 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64c1c516-540e-4bbc-9553-fcf8c353def4 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:35.794078 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-64c1c516-540e-4bbc-9553-fcf8c353def4 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:35.802033 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-64c1c516-540e-4bbc-9553-fcf8c353def4 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1498 microversion: 2.1 time: 0.154894 Nov 24 16:10:35.802802 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 369/754] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:35 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:36.229499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a204eacf-42ee-494b-9280-086ba0286a2b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:36.229934 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a204eacf-42ee-494b-9280-086ba0286a2b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:36.236294 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a204eacf-42ee-494b-9280-086ba0286a2b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:36.236741 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a204eacf-42ee-494b-9280-086ba0286a2b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:36.237548 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a204eacf-42ee-494b-9280-086ba0286a2b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:36.237982 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a204eacf-42ee-494b-9280-086ba0286a2b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:36.263487 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a204eacf-42ee-494b-9280-086ba0286a2b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Going to try to terminate instance {{(pid=116303) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:10:36.342445 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a204eacf-42ee-494b-9280-086ba0286a2b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 204 len: 0 microversion: 2.1 time: 0.116172 Nov 24 16:10:36.343214 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 386/755] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:10:36 2021] DELETE /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:10:36.352275 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ea586498-0b8a-4f48-b0ec-707aee282811 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:36.352883 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ea586498-0b8a-4f48-b0ec-707aee282811 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:36.358800 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea586498-0b8a-4f48-b0ec-707aee282811 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:36.359255 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea586498-0b8a-4f48-b0ec-707aee282811 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:36.360039 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea586498-0b8a-4f48-b0ec-707aee282811 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:36.360476 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ea586498-0b8a-4f48-b0ec-707aee282811 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:36.491386 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ea586498-0b8a-4f48-b0ec-707aee282811 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:36.498562 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ea586498-0b8a-4f48-b0ec-707aee282811 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1504 microversion: 2.1 time: 0.150019 Nov 24 16:10:36.499482 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 370/756] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:36 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:37.517179 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2083916d-9d11-49e3-9df3-fa7d6809d612 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:37.517803 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2083916d-9d11-49e3-9df3-fa7d6809d612 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:37.524213 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2083916d-9d11-49e3-9df3-fa7d6809d612 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:37.524663 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2083916d-9d11-49e3-9df3-fa7d6809d612 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:37.525552 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2083916d-9d11-49e3-9df3-fa7d6809d612 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:37.525991 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2083916d-9d11-49e3-9df3-fa7d6809d612 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:37.659063 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-2083916d-9d11-49e3-9df3-fa7d6809d612 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:37.666500 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2083916d-9d11-49e3-9df3-fa7d6809d612 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1504 microversion: 2.1 time: 0.153400 Nov 24 16:10:37.667073 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 387/757] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:37 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:38.525911 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-7c7d1c21-bb31-49db-bbcb-9672a8f437ab req-45884d34-0ac6-45b5-97b1-b45295a24bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7fc3d1-a0d1-43e5-8986-d780108ce97b", "name": "network-vif-deleted", "tag": "0ef17b69-6b2d-4dcb-8260-0e3639cb1149"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:10:38.527396 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:10:38.527396 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:10:38.535770 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-7c7d1c21-bb31-49db-bbcb-9672a8f437ab req-45884d34-0ac6-45b5-97b1-b45295a24bcb service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:38.536214 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-7c7d1c21-bb31-49db-bbcb-9672a8f437ab req-45884d34-0ac6-45b5-97b1-b45295a24bcb service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:38.551894 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-7c7d1c21-bb31-49db-bbcb-9672a8f437ab req-45884d34-0ac6-45b5-97b1-b45295a24bcb service nova] Creating event network-vif-deleted:0ef17b69-6b2d-4dcb-8260-0e3639cb1149 for instance 9c7fc3d1-a0d1-43e5-8986-d780108ce97b on hv-cinder-81899 Nov 24 16:10:38.556581 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-7c7d1c21-bb31-49db-bbcb-9672a8f437ab req-45884d34-0ac6-45b5-97b1-b45295a24bcb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158677 Nov 24 16:10:38.557262 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 371/758] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:10:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:10:38.682819 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c1a53d95-0037-4403-93b8-098b19335242 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:38.683427 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c1a53d95-0037-4403-93b8-098b19335242 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:38.691252 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c1a53d95-0037-4403-93b8-098b19335242 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:38.691715 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c1a53d95-0037-4403-93b8-098b19335242 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:38.692517 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c1a53d95-0037-4403-93b8-098b19335242 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:38.692951 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c1a53d95-0037-4403-93b8-098b19335242 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:38.728751 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c1a53d95-0037-4403-93b8-098b19335242 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:38.729244 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c1a53d95-0037-4403-93b8-098b19335242 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:38.729693 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.objects.instance [None req-c1a53d95-0037-4403-93b8-098b19335242 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lazy-loading 'fault' on Instance uuid 9c7fc3d1-a0d1-43e5-8986-d780108ce97b {{(pid=116303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:10:39.025304 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c1a53d95-0037-4403-93b8-098b19335242 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:39.033160 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c1a53d95-0037-4403-93b8-098b19335242 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 200 len: 1304 microversion: 2.1 time: 0.354343 Nov 24 16:10:39.033730 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 388/759] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:38 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 1304 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:40.051840 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-aa8f6dda-844f-4393-96a6-dfc39003234f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:40.052582 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-aa8f6dda-844f-4393-96a6-dfc39003234f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 9c7fc3d1-a0d1-43e5-8986-d780108ce97b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:40.060161 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aa8f6dda-844f-4393-96a6-dfc39003234f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:40.060900 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aa8f6dda-844f-4393-96a6-dfc39003234f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:40.061771 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aa8f6dda-844f-4393-96a6-dfc39003234f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:40.062283 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aa8f6dda-844f-4393-96a6-dfc39003234f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:40.078597 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-aa8f6dda-844f-4393-96a6-dfc39003234f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] HTTP exception thrown: Instance 9c7fc3d1-a0d1-43e5-8986-d780108ce97b could not be found. Nov 24 16:10:40.079311 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-aa8f6dda-844f-4393-96a6-dfc39003234f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Returning 404 to user: Instance 9c7fc3d1-a0d1-43e5-8986-d780108ce97b could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:10:40.080211 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-aa8f6dda-844f-4393-96a6-dfc39003234f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b" status: 404 len: 111 microversion: 2.1 time: 0.033625 Nov 24 16:10:40.085091 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 372/760] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:40 2021] GET /compute/v2.1/servers/9c7fc3d1-a0d1-43e5-8986-d780108ce97b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:10:40.132934 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-124931006", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "networks": [{"uuid": "0f425afc-3f71-4bdb-94b6-fb87f034ecf4"}]}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:10:40.186098 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.network.neutron [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] validate_networks() for [('0f425afc-3f71-4bdb-94b6-fb87f034ecf4', None, None, None, None, None)] {{(pid=116303) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:10:40.567563 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Flavor limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:10:40.567982 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Image limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:10:40.568450 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Flavor pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:10:40.568856 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Image pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:10:40.569290 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:10:40.578586 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:40.579017 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:40.579833 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:40.580267 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:40.596959 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Getting quotas for project 342ef6b52f7f4b9a87df95d6eaaad436. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:10:40.600891 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Getting quotas for user 10dd3ee140864d3ead94c10cea52c5e4 and project 342ef6b52f7f4b9a87df95d6eaaad436. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:10:40.612116 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Going to run 1 instances... {{(pid=116303) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:10:40.614443 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:10:40.659128 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f5f976d4-12ba-4075-9a51-22ed96b3ec02 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529842 Nov 24 16:10:40.664518 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 389/761] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:10:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:10:40.669737 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-26a01a6d-7bc8-4b20-a9f5-55ca990dbabb tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:40.670424 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-26a01a6d-7bc8-4b20-a9f5-55ca990dbabb tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:40.729931 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-26a01a6d-7bc8-4b20-a9f5-55ca990dbabb tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:40.737444 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-26a01a6d-7bc8-4b20-a9f5-55ca990dbabb tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1213 microversion: 2.1 time: 0.071427 Nov 24 16:10:40.738255 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 373/762] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:40 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:41.755272 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c5525996-b81a-45b4-b0ff-6a8c488ffc6b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:41.755866 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c5525996-b81a-45b4-b0ff-6a8c488ffc6b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:41.761870 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c5525996-b81a-45b4-b0ff-6a8c488ffc6b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:41.762312 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c5525996-b81a-45b4-b0ff-6a8c488ffc6b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:41.763081 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c5525996-b81a-45b4-b0ff-6a8c488ffc6b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:41.763603 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c5525996-b81a-45b4-b0ff-6a8c488ffc6b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:41.824358 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c5525996-b81a-45b4-b0ff-6a8c488ffc6b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:41.833332 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c5525996-b81a-45b4-b0ff-6a8c488ffc6b tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1217 microversion: 2.1 time: 0.081884 Nov 24 16:10:41.834252 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 390/763] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:41 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:10:42.850969 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-36d68f1e-6326-4657-8999-1555861711e5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:42.851829 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-36d68f1e-6326-4657-8999-1555861711e5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:42.860868 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-36d68f1e-6326-4657-8999-1555861711e5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:42.861504 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-36d68f1e-6326-4657-8999-1555861711e5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:42.862544 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-36d68f1e-6326-4657-8999-1555861711e5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:42.863102 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-36d68f1e-6326-4657-8999-1555861711e5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:42.929663 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-36d68f1e-6326-4657-8999-1555861711e5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:42.937134 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-36d68f1e-6326-4657-8999-1555861711e5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1217 microversion: 2.1 time: 0.090246 Nov 24 16:10:42.937833 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 374/764] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:42 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:43.955241 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6ffd6719-3738-4658-a545-06d27bf87077 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:43.955874 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6ffd6719-3738-4658-a545-06d27bf87077 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:43.961904 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6ffd6719-3738-4658-a545-06d27bf87077 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:43.962350 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6ffd6719-3738-4658-a545-06d27bf87077 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:43.963134 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6ffd6719-3738-4658-a545-06d27bf87077 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:43.963583 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6ffd6719-3738-4658-a545-06d27bf87077 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:44.022146 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6ffd6719-3738-4658-a545-06d27bf87077 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:44.029371 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6ffd6719-3738-4658-a545-06d27bf87077 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1209 microversion: 2.1 time: 0.078704 Nov 24 16:10:44.029948 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 391/765] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:43 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1209 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:45.046516 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ef5df0ae-cfa6-4f95-9251-0110d9801bee tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:45.047407 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ef5df0ae-cfa6-4f95-9251-0110d9801bee tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:45.053381 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5df0ae-cfa6-4f95-9251-0110d9801bee tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:45.053837 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5df0ae-cfa6-4f95-9251-0110d9801bee tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:45.054625 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5df0ae-cfa6-4f95-9251-0110d9801bee tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:45.055061 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef5df0ae-cfa6-4f95-9251-0110d9801bee tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:45.149280 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ef5df0ae-cfa6-4f95-9251-0110d9801bee tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:45.156884 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ef5df0ae-cfa6-4f95-9251-0110d9801bee tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1271 microversion: 2.1 time: 0.114139 Nov 24 16:10:45.157501 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 375/766] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:45 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:46.158763 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-cf781e05-3691-489b-a824-02f347faecfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab293fa-b007-4902-940e-04f5bb4f953b", "tag": "df16fe47-5144-47de-bf63-d5685166da50"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:10:46.160799 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:10:46.160799 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:10:46.169062 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-cf781e05-3691-489b-a824-02f347faecfb service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:46.169625 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-cf781e05-3691-489b-a824-02f347faecfb service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:46.174052 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-115f32b6-072d-4492-9c6e-f05da18692c6 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:46.182327 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-cf781e05-3691-489b-a824-02f347faecfb service nova] Creating event network-changed:df16fe47-5144-47de-bf63-d5685166da50 for instance 4ab293fa-b007-4902-940e-04f5bb4f953b on hv-cinder-81899 Nov 24 16:10:46.185565 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-115f32b6-072d-4492-9c6e-f05da18692c6 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:46.187744 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-c948a8fc-e4e3-4e64-9993-cceb4ce8d0fb req-cf781e05-3691-489b-a824-02f347faecfb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034117 Nov 24 16:10:46.189668 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 392/767] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:10:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:10:46.192875 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-115f32b6-072d-4492-9c6e-f05da18692c6 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:46.193363 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-115f32b6-072d-4492-9c6e-f05da18692c6 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:46.194158 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-115f32b6-072d-4492-9c6e-f05da18692c6 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:46.194623 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-115f32b6-072d-4492-9c6e-f05da18692c6 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:46.399995 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-115f32b6-072d-4492-9c6e-f05da18692c6 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:46.408366 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-115f32b6-072d-4492-9c6e-f05da18692c6 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1313 microversion: 2.1 time: 0.238325 Nov 24 16:10:46.409724 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 376/768] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:46 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:10:47.427654 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a4723721-b832-4aa3-a5b3-4435f8c262a0 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:47.428353 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a4723721-b832-4aa3-a5b3-4435f8c262a0 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:47.434557 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a4723721-b832-4aa3-a5b3-4435f8c262a0 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:47.435010 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a4723721-b832-4aa3-a5b3-4435f8c262a0 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:47.435794 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a4723721-b832-4aa3-a5b3-4435f8c262a0 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:47.436308 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a4723721-b832-4aa3-a5b3-4435f8c262a0 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:47.566095 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a4723721-b832-4aa3-a5b3-4435f8c262a0 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:47.573855 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a4723721-b832-4aa3-a5b3-4435f8c262a0 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1313 microversion: 2.1 time: 0.150658 Nov 24 16:10:47.575011 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 393/769] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:47 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:48.591783 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-824348db-d93d-4281-a452-ced42bfef80f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:48.592338 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-824348db-d93d-4281-a452-ced42bfef80f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:48.599177 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-824348db-d93d-4281-a452-ced42bfef80f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:48.599626 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-824348db-d93d-4281-a452-ced42bfef80f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:48.600418 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-824348db-d93d-4281-a452-ced42bfef80f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:48.600855 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-824348db-d93d-4281-a452-ced42bfef80f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:48.738181 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-824348db-d93d-4281-a452-ced42bfef80f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:48.746473 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-824348db-d93d-4281-a452-ced42bfef80f tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1313 microversion: 2.1 time: 0.158386 Nov 24 16:10:48.747095 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 377/770] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:48 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:49.765901 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-447255ce-35cc-41db-9e1c-274689cd9cc2 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:49.766452 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-447255ce-35cc-41db-9e1c-274689cd9cc2 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:49.773186 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-447255ce-35cc-41db-9e1c-274689cd9cc2 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:49.773627 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-447255ce-35cc-41db-9e1c-274689cd9cc2 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:49.774407 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-447255ce-35cc-41db-9e1c-274689cd9cc2 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:49.774838 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-447255ce-35cc-41db-9e1c-274689cd9cc2 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:49.913531 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-447255ce-35cc-41db-9e1c-274689cd9cc2 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:49.921790 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-447255ce-35cc-41db-9e1c-274689cd9cc2 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1313 microversion: 2.1 time: 0.159382 Nov 24 16:10:49.922521 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 394/771] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:49 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:50.939835 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7d1fa846-e2ac-4086-9750-b0ec6cb1e0fc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:50.940446 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7d1fa846-e2ac-4086-9750-b0ec6cb1e0fc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:50.947133 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7d1fa846-e2ac-4086-9750-b0ec6cb1e0fc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:50.947593 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7d1fa846-e2ac-4086-9750-b0ec6cb1e0fc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:50.948371 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7d1fa846-e2ac-4086-9750-b0ec6cb1e0fc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:50.948801 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7d1fa846-e2ac-4086-9750-b0ec6cb1e0fc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:51.088685 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7d1fa846-e2ac-4086-9750-b0ec6cb1e0fc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:51.095998 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7d1fa846-e2ac-4086-9750-b0ec6cb1e0fc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1313 microversion: 2.1 time: 0.160832 Nov 24 16:10:51.096568 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 378/772] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:50 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:52.112761 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-faeea81d-96c3-4ac8-b619-7327153ac0ba tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:52.113383 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-faeea81d-96c3-4ac8-b619-7327153ac0ba tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:52.119745 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-faeea81d-96c3-4ac8-b619-7327153ac0ba tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:52.120193 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-faeea81d-96c3-4ac8-b619-7327153ac0ba tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:52.120972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-faeea81d-96c3-4ac8-b619-7327153ac0ba tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:52.121441 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-faeea81d-96c3-4ac8-b619-7327153ac0ba tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:52.254232 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-faeea81d-96c3-4ac8-b619-7327153ac0ba tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:52.261517 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-faeea81d-96c3-4ac8-b619-7327153ac0ba tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1313 microversion: 2.1 time: 0.152389 Nov 24 16:10:52.262095 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 395/773] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:52 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:52.397154 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-41075840-ed8e-4c96-a61e-fdcc62a863d5 req-40e4305b-95d0-49ed-bbaa-bd945cb5a167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab293fa-b007-4902-940e-04f5bb4f953b", "name": "network-vif-plugged", "status": "completed", "tag": "df16fe47-5144-47de-bf63-d5685166da50"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:10:52.398831 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:10:52.398831 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:10:52.405948 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-41075840-ed8e-4c96-a61e-fdcc62a863d5 req-40e4305b-95d0-49ed-bbaa-bd945cb5a167 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:52.406540 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-41075840-ed8e-4c96-a61e-fdcc62a863d5 req-40e4305b-95d0-49ed-bbaa-bd945cb5a167 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:52.417913 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-41075840-ed8e-4c96-a61e-fdcc62a863d5 req-40e4305b-95d0-49ed-bbaa-bd945cb5a167 service nova] Creating event network-vif-plugged:df16fe47-5144-47de-bf63-d5685166da50 for instance 4ab293fa-b007-4902-940e-04f5bb4f953b on hv-cinder-81899 Nov 24 16:10:52.424162 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-41075840-ed8e-4c96-a61e-fdcc62a863d5 req-40e4305b-95d0-49ed-bbaa-bd945cb5a167 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030334 Nov 24 16:10:52.424781 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 379/774] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:10:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:10:53.277496 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3394ca26-0889-4dee-a406-21556596dbe5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:53.278220 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3394ca26-0889-4dee-a406-21556596dbe5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:53.285329 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3394ca26-0889-4dee-a406-21556596dbe5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:53.285775 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3394ca26-0889-4dee-a406-21556596dbe5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:53.286557 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3394ca26-0889-4dee-a406-21556596dbe5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:53.286990 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3394ca26-0889-4dee-a406-21556596dbe5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:53.420079 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3394ca26-0889-4dee-a406-21556596dbe5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:53.427973 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3394ca26-0889-4dee-a406-21556596dbe5 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1313 microversion: 2.1 time: 0.154135 Nov 24 16:10:53.428565 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 396/775] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:53 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:54.445602 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1d1d93ec-5856-4cb3-abec-c1fdedb8b461 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:54.446296 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1d1d93ec-5856-4cb3-abec-c1fdedb8b461 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:54.452401 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1d1d93ec-5856-4cb3-abec-c1fdedb8b461 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:54.453232 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1d1d93ec-5856-4cb3-abec-c1fdedb8b461 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:54.454077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1d1d93ec-5856-4cb3-abec-c1fdedb8b461 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:54.454481 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1d1d93ec-5856-4cb3-abec-c1fdedb8b461 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:54.600218 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1d1d93ec-5856-4cb3-abec-c1fdedb8b461 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:54.607655 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1d1d93ec-5856-4cb3-abec-c1fdedb8b461 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1497 microversion: 2.1 time: 0.166585 Nov 24 16:10:54.608228 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 380/776] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:54 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:55.035532 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:55.036035 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:55.042258 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:55.042705 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:55.043482 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:55.043915 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:55.069071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Going to try to terminate instance {{(pid=116303) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:10:55.143903 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2a45e7cb-3808-4ddf-aa86-90e52b0b7617 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 204 len: 0 microversion: 2.1 time: 0.111733 Nov 24 16:10:55.145053 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 397/777] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:10:55 2021] DELETE /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:10:55.152361 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fc7903bb-6b74-4c29-ab60-4d36a45b7aeb tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:55.152975 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fc7903bb-6b74-4c29-ab60-4d36a45b7aeb tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:55.159516 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fc7903bb-6b74-4c29-ab60-4d36a45b7aeb tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:55.159961 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fc7903bb-6b74-4c29-ab60-4d36a45b7aeb tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:55.160738 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fc7903bb-6b74-4c29-ab60-4d36a45b7aeb tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:55.161199 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fc7903bb-6b74-4c29-ab60-4d36a45b7aeb tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:55.297575 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fc7903bb-6b74-4c29-ab60-4d36a45b7aeb tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:55.305521 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fc7903bb-6b74-4c29-ab60-4d36a45b7aeb tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1503 microversion: 2.1 time: 0.156746 Nov 24 16:10:55.306092 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 381/778] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:55 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:56.323636 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f60119fc-ea2f-486d-ad7c-c2eefc0f4946 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:56.324330 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f60119fc-ea2f-486d-ad7c-c2eefc0f4946 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:56.330800 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f60119fc-ea2f-486d-ad7c-c2eefc0f4946 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:56.331245 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f60119fc-ea2f-486d-ad7c-c2eefc0f4946 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:56.332032 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f60119fc-ea2f-486d-ad7c-c2eefc0f4946 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:56.332465 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f60119fc-ea2f-486d-ad7c-c2eefc0f4946 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:56.467287 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-f60119fc-ea2f-486d-ad7c-c2eefc0f4946 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:56.475588 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f60119fc-ea2f-486d-ad7c-c2eefc0f4946 tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1503 microversion: 2.1 time: 0.155965 Nov 24 16:10:56.476169 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 398/779] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:56 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:10:57.240407 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-f33889c7-225e-4304-a414-49e298417dad req-3a9ad7a0-5927-4f6f-994e-9c06f381d31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab293fa-b007-4902-940e-04f5bb4f953b", "name": "network-vif-deleted", "tag": "df16fe47-5144-47de-bf63-d5685166da50"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:10:57.241932 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:10:57.241932 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:10:57.249841 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-f33889c7-225e-4304-a414-49e298417dad req-3a9ad7a0-5927-4f6f-994e-9c06f381d31d service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:57.250448 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-f33889c7-225e-4304-a414-49e298417dad req-3a9ad7a0-5927-4f6f-994e-9c06f381d31d service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:57.261892 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-f33889c7-225e-4304-a414-49e298417dad req-3a9ad7a0-5927-4f6f-994e-9c06f381d31d service nova] Creating event network-vif-deleted:df16fe47-5144-47de-bf63-d5685166da50 for instance 4ab293fa-b007-4902-940e-04f5bb4f953b on hv-cinder-81899 Nov 24 16:10:57.268153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-f33889c7-225e-4304-a414-49e298417dad req-3a9ad7a0-5927-4f6f-994e-9c06f381d31d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032509 Nov 24 16:10:57.268758 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 399/780] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:10:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:10:57.489788 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-92f2faef-7690-4d4f-a206-3371b4013cfb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:57.490303 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-92f2faef-7690-4d4f-a206-3371b4013cfb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:57.493568 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b9d05f12-1da3-4b61-b0f2-62d99a1a96dc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:57.494254 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b9d05f12-1da3-4b61-b0f2-62d99a1a96dc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:57.496198 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-92f2faef-7690-4d4f-a206-3371b4013cfb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:57.496643 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-92f2faef-7690-4d4f-a206-3371b4013cfb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:57.497471 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-92f2faef-7690-4d4f-a206-3371b4013cfb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:57.497906 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-92f2faef-7690-4d4f-a206-3371b4013cfb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:57.501515 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b9d05f12-1da3-4b61-b0f2-62d99a1a96dc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:57.501952 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b9d05f12-1da3-4b61-b0f2-62d99a1a96dc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:57.502731 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b9d05f12-1da3-4b61-b0f2-62d99a1a96dc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:57.503154 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b9d05f12-1da3-4b61-b0f2-62d99a1a96dc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:57.535930 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b9d05f12-1da3-4b61-b0f2-62d99a1a96dc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:57.535930 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b9d05f12-1da3-4b61-b0f2-62d99a1a96dc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:57.535930 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.objects.instance [None req-b9d05f12-1da3-4b61-b0f2-62d99a1a96dc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lazy-loading 'fault' on Instance uuid 4ab293fa-b007-4902-940e-04f5bb4f953b {{(pid=116303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:10:57.581419 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b9d05f12-1da3-4b61-b0f2-62d99a1a96dc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd3ee140864d3ead94c10cea52c5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342ef6b52f7f4b9a87df95d6eaaad436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:10:57.581641 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-92f2faef-7690-4d4f-a206-3371b4013cfb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lazy-loading 'services' on Instance uuid 80f67d55-afc9-4ce8-a9c5-8256298c4b7e {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:10:57.588701 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b9d05f12-1da3-4b61-b0f2-62d99a1a96dc tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 200 len: 1303 microversion: 2.1 time: 0.099537 Nov 24 16:10:57.589307 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 400/781] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:57 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:10:57.654329 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-92f2faef-7690-4d4f-a206-3371b4013cfb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "DELETE /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/os-volume_attachments/e597164f-3a7a-4d5f-acec-17142de4e3fb" status: 202 len: 0 microversion: 2.1 time: 0.424583 Nov 24 16:10:57.654943 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 382/782] 10.222.0.72 () {58 vars in 1415 bytes} [Wed Nov 24 16:10:57 2021] DELETE /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/os-volume_attachments/e597164f-3a7a-4d5f-acec-17142de4e3fb => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:10:58.606674 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-afdc5bbe-cd24-4947-ac9f-4cab9100096a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:10:58.607241 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-afdc5bbe-cd24-4947-ac9f-4cab9100096a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] [instance: 4ab293fa-b007-4902-940e-04f5bb4f953b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:10:58.614110 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-afdc5bbe-cd24-4947-ac9f-4cab9100096a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:58.614562 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-afdc5bbe-cd24-4947-ac9f-4cab9100096a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:58.615350 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-afdc5bbe-cd24-4947-ac9f-4cab9100096a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:10:58.615785 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-afdc5bbe-cd24-4947-ac9f-4cab9100096a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:10:58.630541 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-afdc5bbe-cd24-4947-ac9f-4cab9100096a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] HTTP exception thrown: Instance 4ab293fa-b007-4902-940e-04f5bb4f953b could not be found. Nov 24 16:10:58.631214 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-afdc5bbe-cd24-4947-ac9f-4cab9100096a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] Returning 404 to user: Instance 4ab293fa-b007-4902-940e-04f5bb4f953b could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:10:58.632131 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-afdc5bbe-cd24-4947-ac9f-4cab9100096a tempest-VolumesActionsTest-1272651029 tempest-VolumesActionsTest-1272651029-project] 10.222.0.72 "GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b" status: 404 len: 111 microversion: 2.1 time: 0.029310 Nov 24 16:10:58.632759 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 401/783] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:10:58 2021] GET /compute/v2.1/servers/4ab293fa-b007-4902-940e-04f5bb4f953b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:11:08.243270 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a20d1cbf-d937-4893-b950-5bc2b65db66a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:11:08.253861 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a20d1cbf-d937-4893-b950-5bc2b65db66a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:08.254747 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a20d1cbf-d937-4893-b950-5bc2b65db66a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:08.285819 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a20d1cbf-d937-4893-b950-5bc2b65db66a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Going to try to stop instance {{(pid=116304) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 24 16:11:08.347571 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a20d1cbf-d937-4893-b950-5bc2b65db66a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 202 len: 0 microversion: 2.1 time: 0.110610 Nov 24 16:11:08.351991 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 383/784] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:11:08 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:11:08.361269 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-48c6c8f9-922c-490c-9c08-a98b33477b6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:08.361878 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-48c6c8f9-922c-490c-9c08-a98b33477b6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:08.377314 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-48c6c8f9-922c-490c-9c08-a98b33477b6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:08.378307 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-48c6c8f9-922c-490c-9c08-a98b33477b6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:08.379220 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-48c6c8f9-922c-490c-9c08-a98b33477b6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:08.379948 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-48c6c8f9-922c-490c-9c08-a98b33477b6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:08.560102 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-48c6c8f9-922c-490c-9c08-a98b33477b6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:08.571883 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-48c6c8f9-922c-490c-9c08-a98b33477b6c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1676 microversion: 2.1 time: 0.217240 Nov 24 16:11:08.581610 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 402/785] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:08 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:09.591089 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-aab3fb52-a0f1-4525-a0db-51123ad1740c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:09.591807 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-aab3fb52-a0f1-4525-a0db-51123ad1740c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:09.603623 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aab3fb52-a0f1-4525-a0db-51123ad1740c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:09.604453 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aab3fb52-a0f1-4525-a0db-51123ad1740c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:09.605904 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aab3fb52-a0f1-4525-a0db-51123ad1740c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:09.606659 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-aab3fb52-a0f1-4525-a0db-51123ad1740c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:09.767399 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-aab3fb52-a0f1-4525-a0db-51123ad1740c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:09.790224 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-aab3fb52-a0f1-4525-a0db-51123ad1740c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1676 microversion: 2.1 time: 0.203686 Nov 24 16:11:09.791097 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 384/786] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:09 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1676 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:10.808040 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8309b320-a4d3-4a7d-a28a-e15049d3067d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:10.808867 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8309b320-a4d3-4a7d-a28a-e15049d3067d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:10.816436 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8309b320-a4d3-4a7d-a28a-e15049d3067d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:10.817072 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8309b320-a4d3-4a7d-a28a-e15049d3067d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:10.818181 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8309b320-a4d3-4a7d-a28a-e15049d3067d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:10.818181 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8309b320-a4d3-4a7d-a28a-e15049d3067d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:10.975998 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8309b320-a4d3-4a7d-a28a-e15049d3067d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:10.983638 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8309b320-a4d3-4a7d-a28a-e15049d3067d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1676 microversion: 2.1 time: 0.179405 Nov 24 16:11:10.993959 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 403/787] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:10 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:12.002256 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c6182ad0-c3e1-4d92-bd1f-de7496d53422 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:12.002879 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c6182ad0-c3e1-4d92-bd1f-de7496d53422 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:12.010136 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6182ad0-c3e1-4d92-bd1f-de7496d53422 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:12.011444 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6182ad0-c3e1-4d92-bd1f-de7496d53422 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:12.012512 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6182ad0-c3e1-4d92-bd1f-de7496d53422 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:12.013112 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c6182ad0-c3e1-4d92-bd1f-de7496d53422 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:12.157881 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c6182ad0-c3e1-4d92-bd1f-de7496d53422 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:12.165832 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c6182ad0-c3e1-4d92-bd1f-de7496d53422 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1676 microversion: 2.1 time: 0.168370 Nov 24 16:11:12.181527 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 385/788] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:11 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:13.183585 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-694e121d-dc93-418a-9aca-a3e1829d381d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:13.184255 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-694e121d-dc93-418a-9aca-a3e1829d381d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:13.191639 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-694e121d-dc93-418a-9aca-a3e1829d381d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:13.192088 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-694e121d-dc93-418a-9aca-a3e1829d381d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:13.192911 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-694e121d-dc93-418a-9aca-a3e1829d381d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:13.193390 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-694e121d-dc93-418a-9aca-a3e1829d381d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:13.354828 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-694e121d-dc93-418a-9aca-a3e1829d381d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:13.363687 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-694e121d-dc93-418a-9aca-a3e1829d381d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1676 microversion: 2.1 time: 0.183681 Nov 24 16:11:13.364609 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 404/789] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:13 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:14.383814 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b4b6493e-825c-4f26-bf7c-b1b9845a6695 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:14.384505 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b4b6493e-825c-4f26-bf7c-b1b9845a6695 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:14.391569 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b4b6493e-825c-4f26-bf7c-b1b9845a6695 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:14.392288 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b4b6493e-825c-4f26-bf7c-b1b9845a6695 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:14.393143 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b4b6493e-825c-4f26-bf7c-b1b9845a6695 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:14.393587 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b4b6493e-825c-4f26-bf7c-b1b9845a6695 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:14.554286 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b4b6493e-825c-4f26-bf7c-b1b9845a6695 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:14.562813 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b4b6493e-825c-4f26-bf7c-b1b9845a6695 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1676 microversion: 2.1 time: 0.183559 Nov 24 16:11:14.563684 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 386/790] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:14 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:15.587235 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1d89ccf3-fbee-4a1d-9a1e-98447fe99f9d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:15.588270 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1d89ccf3-fbee-4a1d-9a1e-98447fe99f9d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:15.599760 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1d89ccf3-fbee-4a1d-9a1e-98447fe99f9d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:15.600209 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1d89ccf3-fbee-4a1d-9a1e-98447fe99f9d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:15.601013 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1d89ccf3-fbee-4a1d-9a1e-98447fe99f9d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:15.601482 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1d89ccf3-fbee-4a1d-9a1e-98447fe99f9d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:15.778911 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1d89ccf3-fbee-4a1d-9a1e-98447fe99f9d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:15.793347 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1d89ccf3-fbee-4a1d-9a1e-98447fe99f9d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1676 microversion: 2.1 time: 0.212020 Nov 24 16:11:15.794617 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 405/791] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:15 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:11:16.820923 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-18e18a79-4f95-40a5-af63-3d048087b79a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:16.821804 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-18e18a79-4f95-40a5-af63-3d048087b79a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:16.830374 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-18e18a79-4f95-40a5-af63-3d048087b79a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:16.830824 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-18e18a79-4f95-40a5-af63-3d048087b79a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:16.831670 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-18e18a79-4f95-40a5-af63-3d048087b79a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:16.832713 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-18e18a79-4f95-40a5-af63-3d048087b79a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:16.981777 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-18e18a79-4f95-40a5-af63-3d048087b79a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:16.989943 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-18e18a79-4f95-40a5-af63-3d048087b79a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1676 microversion: 2.1 time: 0.174563 Nov 24 16:11:16.990723 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 387/792] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:16 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:18.012014 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-584a8eba-a25e-4a9f-9aeb-d1313eaf023f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:18.012856 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-584a8eba-a25e-4a9f-9aeb-d1313eaf023f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:18.020768 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-584a8eba-a25e-4a9f-9aeb-d1313eaf023f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:18.021613 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-584a8eba-a25e-4a9f-9aeb-d1313eaf023f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:18.022694 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-584a8eba-a25e-4a9f-9aeb-d1313eaf023f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:18.023156 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-584a8eba-a25e-4a9f-9aeb-d1313eaf023f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:18.184201 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-584a8eba-a25e-4a9f-9aeb-d1313eaf023f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:18.195499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-584a8eba-a25e-4a9f-9aeb-d1313eaf023f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1676 microversion: 2.1 time: 0.187404 Nov 24 16:11:18.197369 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 406/793] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:18 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:19.214032 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-19155918-b5c9-4ab7-91e6-d34f01d88ed2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:19.218624 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-19155918-b5c9-4ab7-91e6-d34f01d88ed2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:19.221868 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19155918-b5c9-4ab7-91e6-d34f01d88ed2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:19.222336 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19155918-b5c9-4ab7-91e6-d34f01d88ed2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:19.223149 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19155918-b5c9-4ab7-91e6-d34f01d88ed2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:19.223584 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-19155918-b5c9-4ab7-91e6-d34f01d88ed2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:19.376267 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-19155918-b5c9-4ab7-91e6-d34f01d88ed2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:19.386069 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-19155918-b5c9-4ab7-91e6-d34f01d88ed2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1676 microversion: 2.1 time: 0.175370 Nov 24 16:11:19.386654 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 388/794] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:19 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:19.801876 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-132ec1e4-4145-4608-8a51-7d07f98bc9ed tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:11:19.802817 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-132ec1e4-4145-4608-8a51-7d07f98bc9ed tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:19.809707 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-132ec1e4-4145-4608-8a51-7d07f98bc9ed tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:19.810419 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-132ec1e4-4145-4608-8a51-7d07f98bc9ed tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:19.812008 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-132ec1e4-4145-4608-8a51-7d07f98bc9ed tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:19.812443 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-132ec1e4-4145-4608-8a51-7d07f98bc9ed tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:19.899692 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-132ec1e4-4145-4608-8a51-7d07f98bc9ed tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "POST /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/action" status: 202 len: 0 microversion: 2.1 time: 0.099673 Nov 24 16:11:19.900788 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 407/795] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:11:19 2021] POST /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:11:19.913875 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-85a1291e-2340-4e9d-a88d-409edc707ed0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:19.914863 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-85a1291e-2340-4e9d-a88d-409edc707ed0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:19.925063 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-85a1291e-2340-4e9d-a88d-409edc707ed0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:19.925528 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-85a1291e-2340-4e9d-a88d-409edc707ed0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:19.926395 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-85a1291e-2340-4e9d-a88d-409edc707ed0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:19.926886 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-85a1291e-2340-4e9d-a88d-409edc707ed0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:20.228742 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-85a1291e-2340-4e9d-a88d-409edc707ed0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:20.247075 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-85a1291e-2340-4e9d-a88d-409edc707ed0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1753 microversion: 2.1 time: 0.340276 Nov 24 16:11:20.249116 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 389/796] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:19 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1753 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:20.406460 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fb1f8a13-2744-45cc-9dfa-ef6189de8bf2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:20.407261 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fb1f8a13-2744-45cc-9dfa-ef6189de8bf2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:20.424301 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fb1f8a13-2744-45cc-9dfa-ef6189de8bf2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:20.424778 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fb1f8a13-2744-45cc-9dfa-ef6189de8bf2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:20.425779 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fb1f8a13-2744-45cc-9dfa-ef6189de8bf2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:20.426427 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fb1f8a13-2744-45cc-9dfa-ef6189de8bf2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:20.605421 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-fb1f8a13-2744-45cc-9dfa-ef6189de8bf2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:20.638147 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fb1f8a13-2744-45cc-9dfa-ef6189de8bf2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1676 microversion: 2.1 time: 0.236225 Nov 24 16:11:20.646039 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 408/797] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:20 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:21.269373 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fa2f5a00-cd5b-4b06-9c45-0f5de0dfc575 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:21.269989 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fa2f5a00-cd5b-4b06-9c45-0f5de0dfc575 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:21.285071 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa2f5a00-cd5b-4b06-9c45-0f5de0dfc575 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:21.285530 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa2f5a00-cd5b-4b06-9c45-0f5de0dfc575 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:21.286373 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa2f5a00-cd5b-4b06-9c45-0f5de0dfc575 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:21.286989 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa2f5a00-cd5b-4b06-9c45-0f5de0dfc575 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:21.470556 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fa2f5a00-cd5b-4b06-9c45-0f5de0dfc575 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:21.479789 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fa2f5a00-cd5b-4b06-9c45-0f5de0dfc575 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1758 microversion: 2.1 time: 0.217220 Nov 24 16:11:21.490122 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 390/798] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:21 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1758 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:21.674342 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7e48eb6b-c171-4252-8d99-486f4bdc486c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:21.675129 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7e48eb6b-c171-4252-8d99-486f4bdc486c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:21.681832 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7e48eb6b-c171-4252-8d99-486f4bdc486c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:21.682655 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7e48eb6b-c171-4252-8d99-486f4bdc486c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:21.683695 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7e48eb6b-c171-4252-8d99-486f4bdc486c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:21.684347 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7e48eb6b-c171-4252-8d99-486f4bdc486c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:21.834928 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7e48eb6b-c171-4252-8d99-486f4bdc486c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:21.847296 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7e48eb6b-c171-4252-8d99-486f4bdc486c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1676 microversion: 2.1 time: 0.176505 Nov 24 16:11:21.857280 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 409/799] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:21 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:22.497458 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1f259df0-eaea-4e56-b7e3-2e38932b3aab tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:22.498095 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1f259df0-eaea-4e56-b7e3-2e38932b3aab tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:22.505249 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1f259df0-eaea-4e56-b7e3-2e38932b3aab tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:22.505995 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1f259df0-eaea-4e56-b7e3-2e38932b3aab tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:22.506793 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1f259df0-eaea-4e56-b7e3-2e38932b3aab tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:22.507230 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1f259df0-eaea-4e56-b7e3-2e38932b3aab tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:22.667080 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1f259df0-eaea-4e56-b7e3-2e38932b3aab tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:22.675550 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1f259df0-eaea-4e56-b7e3-2e38932b3aab tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1758 microversion: 2.1 time: 0.181639 Nov 24 16:11:22.676058 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 391/800] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:22 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:22.864923 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-36ad93ed-6153-463b-a234-9a5b588f4974 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:22.865568 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-36ad93ed-6153-463b-a234-9a5b588f4974 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:22.871721 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-36ad93ed-6153-463b-a234-9a5b588f4974 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:22.872173 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-36ad93ed-6153-463b-a234-9a5b588f4974 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:22.872960 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-36ad93ed-6153-463b-a234-9a5b588f4974 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:22.873426 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-36ad93ed-6153-463b-a234-9a5b588f4974 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:23.012738 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-36ad93ed-6153-463b-a234-9a5b588f4974 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:23.021536 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-36ad93ed-6153-463b-a234-9a5b588f4974 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1676 microversion: 2.1 time: 0.160121 Nov 24 16:11:23.022132 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 410/801] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:22 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:23.692561 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5f39faba-caec-453f-950a-300f6a323156 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:23.693280 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5f39faba-caec-453f-950a-300f6a323156 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:23.700774 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5f39faba-caec-453f-950a-300f6a323156 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:23.701243 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5f39faba-caec-453f-950a-300f6a323156 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:23.702215 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5f39faba-caec-453f-950a-300f6a323156 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:23.702651 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5f39faba-caec-453f-950a-300f6a323156 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:23.851473 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5f39faba-caec-453f-950a-300f6a323156 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:23.860571 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5f39faba-caec-453f-950a-300f6a323156 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1758 microversion: 2.1 time: 0.172030 Nov 24 16:11:23.861201 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 392/802] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:23 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:24.039571 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-83dd365d-b04d-4681-8408-a734561ef7ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:24.040877 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-83dd365d-b04d-4681-8408-a734561ef7ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:24.047915 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-83dd365d-b04d-4681-8408-a734561ef7ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:24.048450 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-83dd365d-b04d-4681-8408-a734561ef7ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:24.049305 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-83dd365d-b04d-4681-8408-a734561ef7ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:24.049752 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-83dd365d-b04d-4681-8408-a734561ef7ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:24.198095 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-83dd365d-b04d-4681-8408-a734561ef7ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:24.206330 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-83dd365d-b04d-4681-8408-a734561ef7ad tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1653 microversion: 2.1 time: 0.170323 Nov 24 16:11:24.207281 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 411/803] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:24 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1653 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:24.224302 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:11:24.231249 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:24.231844 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:24.257994 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Going to try to start instance {{(pid=116304) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 24 16:11:24.318579 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5d02dcea-db4b-4e6a-8059-7e31fa60c9c7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action" status: 202 len: 0 microversion: 2.1 time: 0.096915 Nov 24 16:11:24.319641 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 393/804] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:11:24 2021] POST /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:11:24.334114 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-20e6a14a-0297-4e20-b905-fbe6817221ba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:24.335260 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-20e6a14a-0297-4e20-b905-fbe6817221ba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:24.346191 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-20e6a14a-0297-4e20-b905-fbe6817221ba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:24.347071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-20e6a14a-0297-4e20-b905-fbe6817221ba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:24.348076 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-20e6a14a-0297-4e20-b905-fbe6817221ba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:24.348717 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-20e6a14a-0297-4e20-b905-fbe6817221ba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:24.516054 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-20e6a14a-0297-4e20-b905-fbe6817221ba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:24.524309 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-20e6a14a-0297-4e20-b905-fbe6817221ba tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1662 microversion: 2.1 time: 0.199378 Nov 24 16:11:24.525708 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 412/805] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:24 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1662 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:24.878692 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-99d4eac3-7a2c-4669-b056-98900fcdd803 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:24.879377 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-99d4eac3-7a2c-4669-b056-98900fcdd803 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:24.885817 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-99d4eac3-7a2c-4669-b056-98900fcdd803 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:24.886262 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-99d4eac3-7a2c-4669-b056-98900fcdd803 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:24.887038 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-99d4eac3-7a2c-4669-b056-98900fcdd803 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:24.887469 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-99d4eac3-7a2c-4669-b056-98900fcdd803 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:25.082079 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-99d4eac3-7a2c-4669-b056-98900fcdd803 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:25.089776 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-99d4eac3-7a2c-4669-b056-98900fcdd803 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1758 microversion: 2.1 time: 0.215297 Nov 24 16:11:25.090350 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 394/806] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:24 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1758 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:25.545074 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1434c1a7-7beb-4628-b75c-7e580f6bd101 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:25.545862 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1434c1a7-7beb-4628-b75c-7e580f6bd101 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:25.555058 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1434c1a7-7beb-4628-b75c-7e580f6bd101 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:25.556002 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1434c1a7-7beb-4628-b75c-7e580f6bd101 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:25.556468 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1434c1a7-7beb-4628-b75c-7e580f6bd101 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:25.557094 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1434c1a7-7beb-4628-b75c-7e580f6bd101 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:25.713291 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1434c1a7-7beb-4628-b75c-7e580f6bd101 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:25.722331 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1434c1a7-7beb-4628-b75c-7e580f6bd101 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1666 microversion: 2.1 time: 0.181769 Nov 24 16:11:25.722920 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 413/807] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:25 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1666 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:26.107665 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fa48c540-021b-43c6-b2cc-69f14fd78471 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:26.108263 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fa48c540-021b-43c6-b2cc-69f14fd78471 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:26.115447 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa48c540-021b-43c6-b2cc-69f14fd78471 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:26.115934 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa48c540-021b-43c6-b2cc-69f14fd78471 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:26.116724 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa48c540-021b-43c6-b2cc-69f14fd78471 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:26.117196 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa48c540-021b-43c6-b2cc-69f14fd78471 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:26.494676 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fa48c540-021b-43c6-b2cc-69f14fd78471 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:26.503073 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fa48c540-021b-43c6-b2cc-69f14fd78471 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1758 microversion: 2.1 time: 0.399171 Nov 24 16:11:26.503674 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 395/808] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:26 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1758 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:27.520265 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-07bb0228-5c57-4c56-aa6c-16ea3a2db2b6 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:27.520996 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-07bb0228-5c57-4c56-aa6c-16ea3a2db2b6 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:27.527624 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-07bb0228-5c57-4c56-aa6c-16ea3a2db2b6 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:27.528158 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-07bb0228-5c57-4c56-aa6c-16ea3a2db2b6 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:27.529057 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-07bb0228-5c57-4c56-aa6c-16ea3a2db2b6 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:27.529495 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-07bb0228-5c57-4c56-aa6c-16ea3a2db2b6 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:27.697190 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-07bb0228-5c57-4c56-aa6c-16ea3a2db2b6 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:27.706411 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-07bb0228-5c57-4c56-aa6c-16ea3a2db2b6 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1758 microversion: 2.1 time: 0.190327 Nov 24 16:11:27.707390 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 414/809] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:27 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:28.726905 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-73a7de45-7444-4d6a-b83c-c7e00114acdb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:28.727525 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-73a7de45-7444-4d6a-b83c-c7e00114acdb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:28.734319 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73a7de45-7444-4d6a-b83c-c7e00114acdb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:28.734776 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73a7de45-7444-4d6a-b83c-c7e00114acdb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:28.735572 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73a7de45-7444-4d6a-b83c-c7e00114acdb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:28.735996 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73a7de45-7444-4d6a-b83c-c7e00114acdb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:28.882162 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-73a7de45-7444-4d6a-b83c-c7e00114acdb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:28.893352 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-73a7de45-7444-4d6a-b83c-c7e00114acdb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1758 microversion: 2.1 time: 0.169990 Nov 24 16:11:28.894289 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 396/810] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:28 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:29.911930 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6761b2fe-dc96-4c2c-b410-67ddccb2f82f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:29.912600 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6761b2fe-dc96-4c2c-b410-67ddccb2f82f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:29.919153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6761b2fe-dc96-4c2c-b410-67ddccb2f82f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:29.919594 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6761b2fe-dc96-4c2c-b410-67ddccb2f82f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:29.920380 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6761b2fe-dc96-4c2c-b410-67ddccb2f82f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:29.920819 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6761b2fe-dc96-4c2c-b410-67ddccb2f82f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:30.067426 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6761b2fe-dc96-4c2c-b410-67ddccb2f82f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:30.075317 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6761b2fe-dc96-4c2c-b410-67ddccb2f82f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1758 microversion: 2.1 time: 0.167532 Nov 24 16:11:30.075890 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 415/811] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:29 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:31.093072 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d09f6f86-891e-4d67-a7ec-7eda63ff06d0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:31.094175 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d09f6f86-891e-4d67-a7ec-7eda63ff06d0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:31.100504 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d09f6f86-891e-4d67-a7ec-7eda63ff06d0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:31.100947 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d09f6f86-891e-4d67-a7ec-7eda63ff06d0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:31.101748 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d09f6f86-891e-4d67-a7ec-7eda63ff06d0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:31.102177 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d09f6f86-891e-4d67-a7ec-7eda63ff06d0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:31.251849 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d09f6f86-891e-4d67-a7ec-7eda63ff06d0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:31.260771 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d09f6f86-891e-4d67-a7ec-7eda63ff06d0 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1758 microversion: 2.1 time: 0.171655 Nov 24 16:11:31.261375 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 397/812] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:31 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:32.278573 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-adbe78eb-6b93-4f6f-bea1-df02514e90fb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:32.279210 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-adbe78eb-6b93-4f6f-bea1-df02514e90fb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:32.286054 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-adbe78eb-6b93-4f6f-bea1-df02514e90fb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:32.286494 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-adbe78eb-6b93-4f6f-bea1-df02514e90fb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:32.287279 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-adbe78eb-6b93-4f6f-bea1-df02514e90fb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:32.287710 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-adbe78eb-6b93-4f6f-bea1-df02514e90fb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:32.436060 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-adbe78eb-6b93-4f6f-bea1-df02514e90fb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:32.444604 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-adbe78eb-6b93-4f6f-bea1-df02514e90fb tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1758 microversion: 2.1 time: 0.169679 Nov 24 16:11:32.445210 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 416/813] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:32 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:33.462230 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-32051222-7816-41d6-a201-51bde635843b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:33.462945 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-32051222-7816-41d6-a201-51bde635843b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:33.470702 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-32051222-7816-41d6-a201-51bde635843b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:33.471153 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-32051222-7816-41d6-a201-51bde635843b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:33.471940 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-32051222-7816-41d6-a201-51bde635843b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:33.472373 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-32051222-7816-41d6-a201-51bde635843b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:33.624854 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-32051222-7816-41d6-a201-51bde635843b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:33.632965 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-32051222-7816-41d6-a201-51bde635843b tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1758 microversion: 2.1 time: 0.174371 Nov 24 16:11:33.633575 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 398/814] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:33 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:34.650779 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b1019f81-0e65-4853-a181-5ad646fe4e90 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:34.651387 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b1019f81-0e65-4853-a181-5ad646fe4e90 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:34.658349 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b1019f81-0e65-4853-a181-5ad646fe4e90 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:34.658792 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b1019f81-0e65-4853-a181-5ad646fe4e90 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:34.659581 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b1019f81-0e65-4853-a181-5ad646fe4e90 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:34.660005 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b1019f81-0e65-4853-a181-5ad646fe4e90 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:34.803734 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b1019f81-0e65-4853-a181-5ad646fe4e90 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:34.811391 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b1019f81-0e65-4853-a181-5ad646fe4e90 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1758 microversion: 2.1 time: 0.164276 Nov 24 16:11:34.812282 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 417/815] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:34 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:35.830170 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-745b1415-0705-4389-b128-dcbe9e642f0d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:35.830725 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-745b1415-0705-4389-b128-dcbe9e642f0d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:35.837162 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-745b1415-0705-4389-b128-dcbe9e642f0d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:35.837607 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-745b1415-0705-4389-b128-dcbe9e642f0d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:35.838381 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-745b1415-0705-4389-b128-dcbe9e642f0d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:35.838810 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-745b1415-0705-4389-b128-dcbe9e642f0d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:35.981476 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-745b1415-0705-4389-b128-dcbe9e642f0d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:35.989990 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-745b1415-0705-4389-b128-dcbe9e642f0d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1758 microversion: 2.1 time: 0.164541 Nov 24 16:11:35.990570 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 399/816] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:35 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:36.711210 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:11:36.711336 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: Wed Nov 24 16:11:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:11:37.009359 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1374d560-968c-45f4-9d88-744a1eb15207 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:37.009905 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1374d560-968c-45f4-9d88-744a1eb15207 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:37.016301 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1374d560-968c-45f4-9d88-744a1eb15207 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:37.016744 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1374d560-968c-45f4-9d88-744a1eb15207 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:37.017570 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1374d560-968c-45f4-9d88-744a1eb15207 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:37.018003 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1374d560-968c-45f4-9d88-744a1eb15207 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:37.232716 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1374d560-968c-45f4-9d88-744a1eb15207 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:37.246044 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1374d560-968c-45f4-9d88-744a1eb15207 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1761 microversion: 2.1 time: 0.240355 Nov 24 16:11:37.246647 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 418/817] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:11:37 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1761 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:44.543873 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9703ca5f-04a4-47fc-a11d-a828996aeed1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:44.544451 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9703ca5f-04a4-47fc-a11d-a828996aeed1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:44.551237 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9703ca5f-04a4-47fc-a11d-a828996aeed1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:44.551689 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9703ca5f-04a4-47fc-a11d-a828996aeed1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:44.552476 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9703ca5f-04a4-47fc-a11d-a828996aeed1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:44.552906 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9703ca5f-04a4-47fc-a11d-a828996aeed1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:44.583443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9703ca5f-04a4-47fc-a11d-a828996aeed1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/os-volume_attachments/db69556b-99cd-402f-ab21-c8aee84f024b" status: 200 len: 194 microversion: 2.20 time: 0.043525 Nov 24 16:11:44.584048 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 400/818] 10.222.0.72 () {60 vars in 1453 bytes} [Wed Nov 24 16:11:44 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/os-volume_attachments/db69556b-99cd-402f-ab21-c8aee84f024b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:11:44.648406 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d1e4c134-27a7-4000-8c84-7df1084f5529 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:44.648981 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d1e4c134-27a7-4000-8c84-7df1084f5529 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:44.655701 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d1e4c134-27a7-4000-8c84-7df1084f5529 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:44.656156 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d1e4c134-27a7-4000-8c84-7df1084f5529 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:44.656970 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d1e4c134-27a7-4000-8c84-7df1084f5529 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:44.657447 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d1e4c134-27a7-4000-8c84-7df1084f5529 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:44.741464 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.objects.instance [None req-d1e4c134-27a7-4000-8c84-7df1084f5529 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lazy-loading 'services' on Instance uuid 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 {{(pid=116303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:11:44.813927 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d1e4c134-27a7-4000-8c84-7df1084f5529 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/os-volume_attachments/db69556b-99cd-402f-ab21-c8aee84f024b" status: 202 len: 0 microversion: 2.20 time: 0.169396 Nov 24 16:11:44.814524 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 419/819] 10.222.0.72 () {60 vars in 1456 bytes} [Wed Nov 24 16:11:44 2021] DELETE /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/os-volume_attachments/db69556b-99cd-402f-ab21-c8aee84f024b => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:11:44.822764 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-50454de4-9035-4f62-b394-85c37d8e2993 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:44.824033 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-50454de4-9035-4f62-b394-85c37d8e2993 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:44.830639 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-50454de4-9035-4f62-b394-85c37d8e2993 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:44.831263 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-50454de4-9035-4f62-b394-85c37d8e2993 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:44.832084 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-50454de4-9035-4f62-b394-85c37d8e2993 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:44.832531 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-50454de4-9035-4f62-b394-85c37d8e2993 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:44.875633 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-50454de4-9035-4f62-b394-85c37d8e2993 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056479 Nov 24 16:11:44.876209 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 401/820] 10.222.0.72 () {60 vars in 1342 bytes} [Wed Nov 24 16:11:44 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:11:45.887965 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8c7f8039-0443-4d35-b447-46d423123870 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:45.889078 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8c7f8039-0443-4d35-b447-46d423123870 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:45.895213 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c7f8039-0443-4d35-b447-46d423123870 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:45.895662 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c7f8039-0443-4d35-b447-46d423123870 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:45.896460 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c7f8039-0443-4d35-b447-46d423123870 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:45.896896 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c7f8039-0443-4d35-b447-46d423123870 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:45.927749 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8c7f8039-0443-4d35-b447-46d423123870 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044077 Nov 24 16:11:45.928562 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 420/821] 10.222.0.72 () {60 vars in 1342 bytes} [Wed Nov 24 16:11:45 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:11:45.985768 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:45.986306 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:45.992363 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:45.992860 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:45.993672 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:45.994105 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:46.019693 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:11:46.098074 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-85e533f7-e3a1-4e82-b39c-57b21b05ae85 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 204 len: 0 microversion: 2.20 time: 0.116087 Nov 24 16:11:46.098763 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 402/822] 10.222.0.72 () {60 vars in 1279 bytes} [Wed Nov 24 16:11:45 2021] DELETE /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 16:11:46.107091 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-21bb94a7-a1e7-41f8-8998-f7c2a75180e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:46.107693 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-21bb94a7-a1e7-41f8-8998-f7c2a75180e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:46.114294 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-21bb94a7-a1e7-41f8-8998-f7c2a75180e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:46.114787 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-21bb94a7-a1e7-41f8-8998-f7c2a75180e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:46.115581 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-21bb94a7-a1e7-41f8-8998-f7c2a75180e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:46.116018 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-21bb94a7-a1e7-41f8-8998-f7c2a75180e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:46.255735 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-21bb94a7-a1e7-41f8-8998-f7c2a75180e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:46.263469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-21bb94a7-a1e7-41f8-8998-f7c2a75180e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:46.265581 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-21bb94a7-a1e7-41f8-8998-f7c2a75180e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:46.266735 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-21bb94a7-a1e7-41f8-8998-f7c2a75180e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.163543 Nov 24 16:11:46.267310 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 421/823] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:11:46 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:11:47.285479 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-60a51aaf-02c9-4f12-8a30-2b2b4c0342e8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:47.286311 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-60a51aaf-02c9-4f12-8a30-2b2b4c0342e8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:47.293358 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60a51aaf-02c9-4f12-8a30-2b2b4c0342e8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:47.293859 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60a51aaf-02c9-4f12-8a30-2b2b4c0342e8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:47.294603 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60a51aaf-02c9-4f12-8a30-2b2b4c0342e8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:47.295042 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-60a51aaf-02c9-4f12-8a30-2b2b4c0342e8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:47.435888 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-60a51aaf-02c9-4f12-8a30-2b2b4c0342e8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:47.444264 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-60a51aaf-02c9-4f12-8a30-2b2b4c0342e8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:47.445806 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-60a51aaf-02c9-4f12-8a30-2b2b4c0342e8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:47.446962 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-60a51aaf-02c9-4f12-8a30-2b2b4c0342e8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.165561 Nov 24 16:11:47.447530 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 403/824] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:11:47 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:11:48.464856 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9162eb2b-ae3d-4846-8122-b5aa51e834a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:48.465620 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9162eb2b-ae3d-4846-8122-b5aa51e834a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:48.472110 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9162eb2b-ae3d-4846-8122-b5aa51e834a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:48.472560 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9162eb2b-ae3d-4846-8122-b5aa51e834a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:48.473386 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9162eb2b-ae3d-4846-8122-b5aa51e834a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:48.473824 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9162eb2b-ae3d-4846-8122-b5aa51e834a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:48.611194 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9162eb2b-ae3d-4846-8122-b5aa51e834a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:48.621366 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9162eb2b-ae3d-4846-8122-b5aa51e834a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:48.622925 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9162eb2b-ae3d-4846-8122-b5aa51e834a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:48.625119 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9162eb2b-ae3d-4846-8122-b5aa51e834a1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 200 len: 1723 microversion: 2.20 time: 0.163979 Nov 24 16:11:48.625685 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 422/825] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:11:48 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:11:48.998231 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-de553655-1ff3-472f-85a9-9a1e6882c51a req-c76d4c0d-3291-44e3-bb6d-101ce7602818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6", "name": "network-vif-deleted", "tag": "0cc6f513-6305-463b-bb1d-17ec8928f67c"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:11:49.001427 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:11:49.001427 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:11:49.011228 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-de553655-1ff3-472f-85a9-9a1e6882c51a req-c76d4c0d-3291-44e3-bb6d-101ce7602818 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:49.012446 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-de553655-1ff3-472f-85a9-9a1e6882c51a req-c76d4c0d-3291-44e3-bb6d-101ce7602818 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:49.025716 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-de553655-1ff3-472f-85a9-9a1e6882c51a req-c76d4c0d-3291-44e3-bb6d-101ce7602818 service nova] Creating event network-vif-deleted:0cc6f513-6305-463b-bb1d-17ec8928f67c for instance 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 on hv-cinder-81899 Nov 24 16:11:49.033631 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-de553655-1ff3-472f-85a9-9a1e6882c51a req-c76d4c0d-3291-44e3-bb6d-101ce7602818 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039625 Nov 24 16:11:49.034267 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 404/826] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:11:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:11:49.644539 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f71e100c-4555-49fa-8954-3ec679e9d793 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:49.645115 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f71e100c-4555-49fa-8954-3ec679e9d793 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:49.651601 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f71e100c-4555-49fa-8954-3ec679e9d793 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:49.652055 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f71e100c-4555-49fa-8954-3ec679e9d793 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:49.652841 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f71e100c-4555-49fa-8954-3ec679e9d793 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:49.653305 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f71e100c-4555-49fa-8954-3ec679e9d793 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:49.667504 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-f71e100c-4555-49fa-8954-3ec679e9d793 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] HTTP exception thrown: Instance 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 could not be found. Nov 24 16:11:49.668096 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f71e100c-4555-49fa-8954-3ec679e9d793 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Returning 404 to user: Instance 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:11:49.669080 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f71e100c-4555-49fa-8954-3ec679e9d793 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 404 len: 111 microversion: 2.20 time: 0.028920 Nov 24 16:11:49.669680 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 423/827] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:11:49 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 24 16:11:49.679636 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-db4810b2-1dc2-4c24-9887-6fdfb59d940d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '.version_select at 0x7f361b2dbc10>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:49.703523 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-db4810b2-1dc2-4c24-9887-6fdfb59d940d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-545693207" status: 204 len: 0 microversion: 2.20 time: 0.027780 Nov 24 16:11:49.704348 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 405/828] 10.222.0.72 () {60 vars in 1258 bytes} [Wed Nov 24 16:11:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-545693207 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 16:11:50.434791 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5bf434bd-4de4-442a-aa29-b654b27de21a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'create', calling method: .version_select at 0x7f361abd9c10>, body: {"keypair": {"name": "tempest-keypair-240747284"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:11:50.448818 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-5bf434bd-4de4-442a-aa29-b654b27de21a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Getting quotas for project 4ca913475fb04e7a8ea75d95578c8b84. Resources: {'key_pairs'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:11:50.453006 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-5bf434bd-4de4-442a-aa29-b654b27de21a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Getting quotas for user 8a8a03093ef0437eb8da451bee7dcade and project 4ca913475fb04e7a8ea75d95578c8b84. Resources: {'key_pairs'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:11:50.464559 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5bf434bd-4de4-442a-aa29-b654b27de21a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [dfac7825-2f7f-42da-88ea-d92ae344cb43] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 24 16:11:51.483069 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO oslo.messaging._drivers.impl_rabbit [None req-5bf434bd-4de4-442a-aa29-b654b27de21a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [dfac7825-2f7f-42da-88ea-d92ae344cb43] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 57220. Nov 24 16:11:51.560211 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-5bf434bd-4de4-442a-aa29-b654b27de21a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Getting quotas for project 4ca913475fb04e7a8ea75d95578c8b84. Resources: {'key_pairs'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:11:51.564059 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-5bf434bd-4de4-442a-aa29-b654b27de21a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Getting quotas for user 8a8a03093ef0437eb8da451bee7dcade and project 4ca913475fb04e7a8ea75d95578c8b84. Resources: {'key_pairs'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:11:51.577753 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5bf434bd-4de4-442a-aa29-b654b27de21a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.146591 Nov 24 16:11:51.578530 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 424/829] 10.222.0.72 () {62 vars in 1198 bytes} [Wed Nov 24 16:11:50 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1148 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Nov 24 16:11:52.883883 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1136140050", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "282e5dca-255c-487d-a4fd-a70d7293f6b8"}], "security_groups": [{"name": "tempest-securitygroup--884931115"}], "key_name": "tempest-keypair-240747284", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:11:52.987112 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] validate_networks() for [('282e5dca-255c-487d-a4fd-a70d7293f6b8', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:11:53.348884 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:11:53.349337 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:11:53.349848 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:11:53.350260 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:11:53.350673 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:11:53.359859 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:53.360308 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:53.361142 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:53.361584 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:53.377652 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Getting quotas for project 4ca913475fb04e7a8ea75d95578c8b84. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:11:53.381555 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Getting quotas for user 8a8a03093ef0437eb8da451bee7dcade and project 4ca913475fb04e7a8ea75d95578c8b84. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:11:53.392086 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:11:53.394504 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:11:53.440850 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2a34ceac-babb-4b2d-9c56-bae6a1ad28b1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.561395 Nov 24 16:11:53.441599 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 406/830] 10.222.0.72 () {62 vars in 1187 bytes} [Wed Nov 24 16:11:52 2021] POST /compute/v2.1/servers => generated 401 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 24 16:11:53.452628 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8bf3257d-e5a0-424f-9cd8-cbd0cc7c3373 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:53.453273 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8bf3257d-e5a0-424f-9cd8-cbd0cc7c3373 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:53.510027 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8bf3257d-e5a0-424f-9cd8-cbd0cc7c3373 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:53.517794 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8bf3257d-e5a0-424f-9cd8-cbd0cc7c3373 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:53.519278 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8bf3257d-e5a0-424f-9cd8-cbd0cc7c3373 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:53.520439 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8bf3257d-e5a0-424f-9cd8-cbd0cc7c3373 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1281 microversion: 2.20 time: 0.072459 Nov 24 16:11:53.520987 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 425/831] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:11:53 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:11:54.539528 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3f2d1b88-c8e6-4e62-9af2-646f02ca9dfa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:54.540159 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3f2d1b88-c8e6-4e62-9af2-646f02ca9dfa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:54.548320 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3f2d1b88-c8e6-4e62-9af2-646f02ca9dfa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:54.548937 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3f2d1b88-c8e6-4e62-9af2-646f02ca9dfa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:54.549664 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3f2d1b88-c8e6-4e62-9af2-646f02ca9dfa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:54.550210 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3f2d1b88-c8e6-4e62-9af2-646f02ca9dfa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:54.622826 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3f2d1b88-c8e6-4e62-9af2-646f02ca9dfa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:54.631429 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3f2d1b88-c8e6-4e62-9af2-646f02ca9dfa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:54.632983 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3f2d1b88-c8e6-4e62-9af2-646f02ca9dfa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:54.634346 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3f2d1b88-c8e6-4e62-9af2-646f02ca9dfa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1339 microversion: 2.20 time: 0.099136 Nov 24 16:11:54.634952 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 407/832] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:11:54 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:11:55.653194 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4ba287f4-ecae-46b0-b31c-3e4463a9a8b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:55.655717 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4ba287f4-ecae-46b0-b31c-3e4463a9a8b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:55.662262 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4ba287f4-ecae-46b0-b31c-3e4463a9a8b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:55.662991 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4ba287f4-ecae-46b0-b31c-3e4463a9a8b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:55.663812 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4ba287f4-ecae-46b0-b31c-3e4463a9a8b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:55.664250 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4ba287f4-ecae-46b0-b31c-3e4463a9a8b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:55.742792 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-ac3fcf9b-185a-4e5c-9754-beb4d6f7e250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:11:55.745373 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:11:55.745373 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:11:55.755198 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-ac3fcf9b-185a-4e5c-9754-beb4d6f7e250 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:55.755774 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-ac3fcf9b-185a-4e5c-9754-beb4d6f7e250 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:55.769853 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-ac3fcf9b-185a-4e5c-9754-beb4d6f7e250 service nova] Creating event network-changed:4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 for instance b62212ea-7c11-4095-adf5-a78b04d67de0 on hv-cinder-81899 Nov 24 16:11:55.776331 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-cdcb8297-b532-485e-989c-4f37fb17e0fe req-ac3fcf9b-185a-4e5c-9754-beb4d6f7e250 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037141 Nov 24 16:11:55.776951 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 408/833] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:11:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:11:55.832019 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4ba287f4-ecae-46b0-b31c-3e4463a9a8b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:55.843506 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4ba287f4-ecae-46b0-b31c-3e4463a9a8b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:55.845000 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4ba287f4-ecae-46b0-b31c-3e4463a9a8b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:55.846590 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4ba287f4-ecae-46b0-b31c-3e4463a9a8b8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1406 microversion: 2.20 time: 0.197035 Nov 24 16:11:55.847156 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 426/834] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:11:55 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:11:56.864845 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f67cd99f-5297-4ad4-96c6-dac4dd971639 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:56.865578 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f67cd99f-5297-4ad4-96c6-dac4dd971639 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:56.871667 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f67cd99f-5297-4ad4-96c6-dac4dd971639 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:56.872117 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f67cd99f-5297-4ad4-96c6-dac4dd971639 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:56.873763 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f67cd99f-5297-4ad4-96c6-dac4dd971639 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:56.874281 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f67cd99f-5297-4ad4-96c6-dac4dd971639 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:57.007510 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f67cd99f-5297-4ad4-96c6-dac4dd971639 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:57.016036 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f67cd99f-5297-4ad4-96c6-dac4dd971639 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:57.017576 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f67cd99f-5297-4ad4-96c6-dac4dd971639 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:57.018675 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f67cd99f-5297-4ad4-96c6-dac4dd971639 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1406 microversion: 2.20 time: 0.158600 Nov 24 16:11:57.019242 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 409/835] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:11:56 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:11:58.036261 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fda5ed21-38c2-4c29-bfdf-32909d59a7dc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:58.036860 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fda5ed21-38c2-4c29-bfdf-32909d59a7dc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:58.043355 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fda5ed21-38c2-4c29-bfdf-32909d59a7dc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:58.043804 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fda5ed21-38c2-4c29-bfdf-32909d59a7dc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:58.044583 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fda5ed21-38c2-4c29-bfdf-32909d59a7dc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:58.045140 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fda5ed21-38c2-4c29-bfdf-32909d59a7dc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:58.174103 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-fda5ed21-38c2-4c29-bfdf-32909d59a7dc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:58.182256 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-fda5ed21-38c2-4c29-bfdf-32909d59a7dc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:58.183734 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-fda5ed21-38c2-4c29-bfdf-32909d59a7dc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:58.184828 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fda5ed21-38c2-4c29-bfdf-32909d59a7dc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1406 microversion: 2.20 time: 0.152275 Nov 24 16:11:58.185419 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 427/836] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:11:58 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:11:59.202921 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2fcd18ef-5954-4dbd-8abf-96ab89d3400c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:11:59.203525 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2fcd18ef-5954-4dbd-8abf-96ab89d3400c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:11:59.211109 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2fcd18ef-5954-4dbd-8abf-96ab89d3400c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:59.211583 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2fcd18ef-5954-4dbd-8abf-96ab89d3400c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:59.212372 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2fcd18ef-5954-4dbd-8abf-96ab89d3400c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:11:59.212812 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2fcd18ef-5954-4dbd-8abf-96ab89d3400c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:11:59.342282 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2fcd18ef-5954-4dbd-8abf-96ab89d3400c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:59.350343 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2fcd18ef-5954-4dbd-8abf-96ab89d3400c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:59.351853 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2fcd18ef-5954-4dbd-8abf-96ab89d3400c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:11:59.352942 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2fcd18ef-5954-4dbd-8abf-96ab89d3400c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1406 microversion: 2.20 time: 0.154072 Nov 24 16:11:59.353536 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 410/837] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:11:59 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:12:00.370430 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-629483e8-3732-4a3c-a839-0281189282d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:00.371028 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-629483e8-3732-4a3c-a839-0281189282d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:00.378133 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-629483e8-3732-4a3c-a839-0281189282d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:00.378570 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-629483e8-3732-4a3c-a839-0281189282d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:00.379338 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-629483e8-3732-4a3c-a839-0281189282d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:00.379761 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-629483e8-3732-4a3c-a839-0281189282d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:00.511543 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-629483e8-3732-4a3c-a839-0281189282d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:00.520057 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-629483e8-3732-4a3c-a839-0281189282d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:00.521678 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-629483e8-3732-4a3c-a839-0281189282d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:00.522797 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-629483e8-3732-4a3c-a839-0281189282d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1406 microversion: 2.20 time: 0.155993 Nov 24 16:12:00.523366 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 428/838] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:12:00 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:12:01.541470 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-de11fffb-8e90-415c-b137-465573f79c95 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:01.542339 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-de11fffb-8e90-415c-b137-465573f79c95 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:01.549429 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-de11fffb-8e90-415c-b137-465573f79c95 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:01.549889 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-de11fffb-8e90-415c-b137-465573f79c95 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:01.550683 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-de11fffb-8e90-415c-b137-465573f79c95 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:01.551122 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-de11fffb-8e90-415c-b137-465573f79c95 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:01.681468 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-de11fffb-8e90-415c-b137-465573f79c95 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:01.690005 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-de11fffb-8e90-415c-b137-465573f79c95 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:01.691501 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-de11fffb-8e90-415c-b137-465573f79c95 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:01.692594 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-de11fffb-8e90-415c-b137-465573f79c95 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1406 microversion: 2.20 time: 0.154908 Nov 24 16:12:01.693177 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 411/839] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:12:01 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:12:02.711597 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-18e39a9a-20bd-4077-b2a8-6b8547ad1c2a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:02.712335 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-18e39a9a-20bd-4077-b2a8-6b8547ad1c2a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:02.719098 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-18e39a9a-20bd-4077-b2a8-6b8547ad1c2a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:02.719543 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-18e39a9a-20bd-4077-b2a8-6b8547ad1c2a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:02.720316 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-18e39a9a-20bd-4077-b2a8-6b8547ad1c2a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:02.720748 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-18e39a9a-20bd-4077-b2a8-6b8547ad1c2a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:02.869768 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-18e39a9a-20bd-4077-b2a8-6b8547ad1c2a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:02.877275 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-83ce1526-8eb7-44c7-89a4-2a22da5cb058 req-bdf5e6db-078a-4858-be37-c296949cc453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-plugged", "status": "completed", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:02.878537 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-18e39a9a-20bd-4077-b2a8-6b8547ad1c2a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:02.878999 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:12:02.878999 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:12:02.880028 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-18e39a9a-20bd-4077-b2a8-6b8547ad1c2a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:02.881150 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-18e39a9a-20bd-4077-b2a8-6b8547ad1c2a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1406 microversion: 2.20 time: 0.173243 Nov 24 16:12:02.881706 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 429/840] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:12:02 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:12:02.885884 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-83ce1526-8eb7-44c7-89a4-2a22da5cb058 req-bdf5e6db-078a-4858-be37-c296949cc453 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:02.886329 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-83ce1526-8eb7-44c7-89a4-2a22da5cb058 req-bdf5e6db-078a-4858-be37-c296949cc453 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:02.897512 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-83ce1526-8eb7-44c7-89a4-2a22da5cb058 req-bdf5e6db-078a-4858-be37-c296949cc453 service nova] Creating event network-vif-plugged:4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 for instance b62212ea-7c11-4095-adf5-a78b04d67de0 on hv-cinder-81899 Nov 24 16:12:02.902219 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-83ce1526-8eb7-44c7-89a4-2a22da5cb058 req-bdf5e6db-078a-4858-be37-c296949cc453 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186797 Nov 24 16:12:02.902798 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 412/841] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:12:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:12:03.899547 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3489d603-bc42-4142-9469-c831a5dd777f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:03.900252 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3489d603-bc42-4142-9469-c831a5dd777f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:03.907281 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3489d603-bc42-4142-9469-c831a5dd777f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:03.907729 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3489d603-bc42-4142-9469-c831a5dd777f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:03.908651 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3489d603-bc42-4142-9469-c831a5dd777f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:03.909290 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3489d603-bc42-4142-9469-c831a5dd777f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:04.045189 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3489d603-bc42-4142-9469-c831a5dd777f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:04.052902 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3489d603-bc42-4142-9469-c831a5dd777f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:04.054503 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3489d603-bc42-4142-9469-c831a5dd777f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:04.055592 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3489d603-bc42-4142-9469-c831a5dd777f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1406 microversion: 2.20 time: 0.159806 Nov 24 16:12:04.056147 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 430/842] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:12:03 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:12:05.074373 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dbb33506-8341-4279-a65f-cfef1aea073b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:05.075067 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dbb33506-8341-4279-a65f-cfef1aea073b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:05.081973 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbb33506-8341-4279-a65f-cfef1aea073b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:05.082565 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbb33506-8341-4279-a65f-cfef1aea073b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:05.083523 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbb33506-8341-4279-a65f-cfef1aea073b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:05.084018 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbb33506-8341-4279-a65f-cfef1aea073b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:05.214400 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dbb33506-8341-4279-a65f-cfef1aea073b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:05.223084 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dbb33506-8341-4279-a65f-cfef1aea073b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:05.224580 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dbb33506-8341-4279-a65f-cfef1aea073b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:05.225761 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dbb33506-8341-4279-a65f-cfef1aea073b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1597 microversion: 2.20 time: 0.156020 Nov 24 16:12:05.226326 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 413/843] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:12:05 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1597 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:12:05.244375 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-585f01a8-9a4b-4aef-8984-40f6dbd5824d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:05.244895 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-585f01a8-9a4b-4aef-8984-40f6dbd5824d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:05.251761 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-585f01a8-9a4b-4aef-8984-40f6dbd5824d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:05.252205 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-585f01a8-9a4b-4aef-8984-40f6dbd5824d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:05.253004 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-585f01a8-9a4b-4aef-8984-40f6dbd5824d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:05.253453 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-585f01a8-9a4b-4aef-8984-40f6dbd5824d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:05.331153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-585f01a8-9a4b-4aef-8984-40f6dbd5824d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090485 Nov 24 16:12:05.331746 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 431/844] 10.222.0.72 () {60 vars in 1315 bytes} [Wed Nov 24 16:12:05 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:12:06.493776 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3ed6aa6f-02f8-409d-ab49-1ad8a26bbfd8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:06.494697 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3ed6aa6f-02f8-409d-ab49-1ad8a26bbfd8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:06.508424 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3ed6aa6f-02f8-409d-ab49-1ad8a26bbfd8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:06.508893 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3ed6aa6f-02f8-409d-ab49-1ad8a26bbfd8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:06.509719 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3ed6aa6f-02f8-409d-ab49-1ad8a26bbfd8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:06.510160 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3ed6aa6f-02f8-409d-ab49-1ad8a26bbfd8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:06.567512 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-1b28f724-d642-4b65-b717-73087b70ffe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:06.569099 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:12:06.569099 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:12:06.576821 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-1b28f724-d642-4b65-b717-73087b70ffe4 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:06.577289 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-1b28f724-d642-4b65-b717-73087b70ffe4 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:06.583127 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3ed6aa6f-02f8-409d-ab49-1ad8a26bbfd8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 14 microversion: 2.20 time: 0.092976 Nov 24 16:12:06.586547 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 414/845] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:06 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:06.588896 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-1b28f724-d642-4b65-b717-73087b70ffe4 service nova] Creating event network-changed:4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 for instance b62212ea-7c11-4095-adf5-a78b04d67de0 on hv-cinder-81899 Nov 24 16:12:06.595195 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-35fcd696-3fca-4f32-82be-0c93dfce4430 req-1b28f724-d642-4b65-b717-73087b70ffe4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096528 Nov 24 16:12:06.595799 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 432/846] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:12:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:12:07.598640 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ecfdffb1-896a-4cdf-a0d6-dcd0aee68976 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:07.599686 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ecfdffb1-896a-4cdf-a0d6-dcd0aee68976 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:07.608167 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ecfdffb1-896a-4cdf-a0d6-dcd0aee68976 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:07.608660 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ecfdffb1-896a-4cdf-a0d6-dcd0aee68976 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:07.609800 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ecfdffb1-896a-4cdf-a0d6-dcd0aee68976 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:07.610134 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ecfdffb1-896a-4cdf-a0d6-dcd0aee68976 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:07.668518 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ecfdffb1-896a-4cdf-a0d6-dcd0aee68976 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 14 microversion: 2.20 time: 0.077784 Nov 24 16:12:07.669239 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 415/847] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:07 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:08.681096 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3916264e-efba-46ed-9e87-116034c66848 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:08.682079 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3916264e-efba-46ed-9e87-116034c66848 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:08.689085 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3916264e-efba-46ed-9e87-116034c66848 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:08.689535 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3916264e-efba-46ed-9e87-116034c66848 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:08.690318 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3916264e-efba-46ed-9e87-116034c66848 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:08.690749 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3916264e-efba-46ed-9e87-116034c66848 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:08.752372 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3916264e-efba-46ed-9e87-116034c66848 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 14 microversion: 2.20 time: 0.075495 Nov 24 16:12:08.752909 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 433/848] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:08 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:12:09.764857 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1c33301f-eb6d-4f41-9047-62ecd545f43f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:09.765952 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1c33301f-eb6d-4f41-9047-62ecd545f43f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:09.773366 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1c33301f-eb6d-4f41-9047-62ecd545f43f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:09.773827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1c33301f-eb6d-4f41-9047-62ecd545f43f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:09.774623 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1c33301f-eb6d-4f41-9047-62ecd545f43f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:09.775060 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1c33301f-eb6d-4f41-9047-62ecd545f43f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:09.836765 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1c33301f-eb6d-4f41-9047-62ecd545f43f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 14 microversion: 2.20 time: 0.076461 Nov 24 16:12:09.837512 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 416/849] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:09 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:10.847783 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fceac320-2b85-45e3-8b04-190c084694eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:10.848794 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fceac320-2b85-45e3-8b04-190c084694eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:10.855654 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fceac320-2b85-45e3-8b04-190c084694eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:10.856091 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fceac320-2b85-45e3-8b04-190c084694eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:10.856858 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fceac320-2b85-45e3-8b04-190c084694eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:10.857313 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fceac320-2b85-45e3-8b04-190c084694eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:10.915089 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fceac320-2b85-45e3-8b04-190c084694eb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 14 microversion: 2.20 time: 0.071193 Nov 24 16:12:10.915713 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 434/850] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:10 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:11.927004 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-65a12592-984c-4374-9298-42dfd088ad73 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:11.928002 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-65a12592-984c-4374-9298-42dfd088ad73 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:11.934927 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-65a12592-984c-4374-9298-42dfd088ad73 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:11.935924 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-65a12592-984c-4374-9298-42dfd088ad73 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:11.939349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-65a12592-984c-4374-9298-42dfd088ad73 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:11.939349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-65a12592-984c-4374-9298-42dfd088ad73 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:11.996266 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-65a12592-984c-4374-9298-42dfd088ad73 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 14 microversion: 2.20 time: 0.073149 Nov 24 16:12:11.996900 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 417/851] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:11 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:13.008430 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7bd26a54-ac1a-4923-ba5b-bc2424924460 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:13.009439 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7bd26a54-ac1a-4923-ba5b-bc2424924460 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:13.016651 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7bd26a54-ac1a-4923-ba5b-bc2424924460 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:13.017202 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7bd26a54-ac1a-4923-ba5b-bc2424924460 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:13.017996 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7bd26a54-ac1a-4923-ba5b-bc2424924460 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:13.018429 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7bd26a54-ac1a-4923-ba5b-bc2424924460 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:13.077936 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7bd26a54-ac1a-4923-ba5b-bc2424924460 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 14 microversion: 2.20 time: 0.073440 Nov 24 16:12:13.078560 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 435/852] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:13 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:14.089367 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-56f17308-a787-4304-8ce2-bff4e1e4cb6e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:14.090366 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-56f17308-a787-4304-8ce2-bff4e1e4cb6e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:14.097940 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56f17308-a787-4304-8ce2-bff4e1e4cb6e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:14.098391 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56f17308-a787-4304-8ce2-bff4e1e4cb6e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:14.099184 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56f17308-a787-4304-8ce2-bff4e1e4cb6e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:14.099625 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56f17308-a787-4304-8ce2-bff4e1e4cb6e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:14.159585 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-56f17308-a787-4304-8ce2-bff4e1e4cb6e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 14 microversion: 2.20 time: 0.074220 Nov 24 16:12:14.160210 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 418/853] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:14 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:15.170462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e366865b-a718-442d-81a1-93d6fd1b3728 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:15.171464 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e366865b-a718-442d-81a1-93d6fd1b3728 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:15.179045 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e366865b-a718-442d-81a1-93d6fd1b3728 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:15.179439 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e366865b-a718-442d-81a1-93d6fd1b3728 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:15.180245 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e366865b-a718-442d-81a1-93d6fd1b3728 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:15.180677 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e366865b-a718-442d-81a1-93d6fd1b3728 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:15.251516 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e366865b-a718-442d-81a1-93d6fd1b3728 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 14 microversion: 2.20 time: 0.085153 Nov 24 16:12:15.252360 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 436/854] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:15 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:16.263997 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-786e3607-1561-48ce-9b25-caec0309619d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:16.264999 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-786e3607-1561-48ce-9b25-caec0309619d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:16.272106 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-786e3607-1561-48ce-9b25-caec0309619d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:16.272560 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-786e3607-1561-48ce-9b25-caec0309619d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:16.273389 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-786e3607-1561-48ce-9b25-caec0309619d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:16.273826 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-786e3607-1561-48ce-9b25-caec0309619d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:16.338837 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-786e3607-1561-48ce-9b25-caec0309619d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 14 microversion: 2.20 time: 0.079449 Nov 24 16:12:16.339517 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 419/855] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:16 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:17.351213 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0443fa17-a2f0-427a-b260-07d4d255ba32 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:17.352221 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0443fa17-a2f0-427a-b260-07d4d255ba32 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:17.359817 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0443fa17-a2f0-427a-b260-07d4d255ba32 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:17.360257 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0443fa17-a2f0-427a-b260-07d4d255ba32 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:17.361022 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0443fa17-a2f0-427a-b260-07d4d255ba32 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:17.361468 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0443fa17-a2f0-427a-b260-07d4d255ba32 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:17.437536 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0443fa17-a2f0-427a-b260-07d4d255ba32 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 6451 microversion: 2.20 time: 0.090148 Nov 24 16:12:17.438177 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 437/856] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:17 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 6451 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:12:18.449077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-461540e3-6dda-4c12-850f-74636f955d3a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:18.450712 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-461540e3-6dda-4c12-850f-74636f955d3a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:18.457755 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-461540e3-6dda-4c12-850f-74636f955d3a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:18.458213 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-461540e3-6dda-4c12-850f-74636f955d3a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:18.459026 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-461540e3-6dda-4c12-850f-74636f955d3a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:18.459463 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-461540e3-6dda-4c12-850f-74636f955d3a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:18.529806 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-461540e3-6dda-4c12-850f-74636f955d3a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 15025 microversion: 2.20 time: 0.084594 Nov 24 16:12:18.530450 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 420/857] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:18 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 15025 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:19.541810 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-73ec4067-7d8c-4ccb-baa6-8bd93ffc863e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:19.542716 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-73ec4067-7d8c-4ccb-baa6-8bd93ffc863e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:19.551077 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-73ec4067-7d8c-4ccb-baa6-8bd93ffc863e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:19.551533 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-73ec4067-7d8c-4ccb-baa6-8bd93ffc863e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:19.552327 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-73ec4067-7d8c-4ccb-baa6-8bd93ffc863e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:19.552763 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-73ec4067-7d8c-4ccb-baa6-8bd93ffc863e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:19.633698 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-73ec4067-7d8c-4ccb-baa6-8bd93ffc863e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 18356 microversion: 2.20 time: 0.095912 Nov 24 16:12:19.634630 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 438/858] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:19 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 18356 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:20.645591 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-442c8267-fbe6-4c72-98dd-aa16892e0578 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:20.646789 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-442c8267-fbe6-4c72-98dd-aa16892e0578 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:20.653759 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-442c8267-fbe6-4c72-98dd-aa16892e0578 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:20.654212 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-442c8267-fbe6-4c72-98dd-aa16892e0578 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:20.654999 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-442c8267-fbe6-4c72-98dd-aa16892e0578 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:20.655440 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-442c8267-fbe6-4c72-98dd-aa16892e0578 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:20.729788 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-442c8267-fbe6-4c72-98dd-aa16892e0578 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 19342 microversion: 2.20 time: 0.088155 Nov 24 16:12:20.730479 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 421/859] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:20 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 19342 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:21.359876 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-411da10a-bdb0-464b-86e8-e0ddc36a44ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:21.360907 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-411da10a-bdb0-464b-86e8-e0ddc36a44ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:21.367853 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-411da10a-bdb0-464b-86e8-e0ddc36a44ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:21.368291 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-411da10a-bdb0-464b-86e8-e0ddc36a44ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:21.369079 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-411da10a-bdb0-464b-86e8-e0ddc36a44ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:21.369504 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-411da10a-bdb0-464b-86e8-e0ddc36a44ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:21.400256 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-411da10a-bdb0-464b-86e8-e0ddc36a44ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044474 Nov 24 16:12:21.400808 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 439/860] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:12:21 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:12:21.456787 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-61492975-2b77-401e-b521-6faf4402c796 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:21.457562 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-61492975-2b77-401e-b521-6faf4402c796 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:21.464558 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-61492975-2b77-401e-b521-6faf4402c796 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:21.464949 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-61492975-2b77-401e-b521-6faf4402c796 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:21.466457 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-61492975-2b77-401e-b521-6faf4402c796 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:21.466900 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-61492975-2b77-401e-b521-6faf4402c796 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:21.491847 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-61492975-2b77-401e-b521-6faf4402c796 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:12:21.570841 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-61492975-2b77-401e-b521-6faf4402c796 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "DELETE /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 204 len: 0 microversion: 2.1 time: 0.117672 Nov 24 16:12:21.571929 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 422/861] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:12:21 2021] DELETE /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:12:21.583853 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6a2e1a4a-fffb-4262-a2cb-0652ede711a1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:21.584464 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6a2e1a4a-fffb-4262-a2cb-0652ede711a1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:21.591946 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6a2e1a4a-fffb-4262-a2cb-0652ede711a1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:21.592387 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6a2e1a4a-fffb-4262-a2cb-0652ede711a1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:21.593235 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6a2e1a4a-fffb-4262-a2cb-0652ede711a1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:21.593668 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6a2e1a4a-fffb-4262-a2cb-0652ede711a1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:21.727647 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6a2e1a4a-fffb-4262-a2cb-0652ede711a1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:21.735389 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6a2e1a4a-fffb-4262-a2cb-0652ede711a1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1672 microversion: 2.1 time: 0.155899 Nov 24 16:12:21.736009 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 440/862] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:21 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:12:21.742637 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-39fe8a65-57aa-4005-a26e-6fe8ed35ff5a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:21.743796 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-39fe8a65-57aa-4005-a26e-6fe8ed35ff5a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:21.751486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-39fe8a65-57aa-4005-a26e-6fe8ed35ff5a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:21.751930 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-39fe8a65-57aa-4005-a26e-6fe8ed35ff5a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:21.752715 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-39fe8a65-57aa-4005-a26e-6fe8ed35ff5a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:21.753181 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-39fe8a65-57aa-4005-a26e-6fe8ed35ff5a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:21.824464 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-39fe8a65-57aa-4005-a26e-6fe8ed35ff5a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 21972 microversion: 2.20 time: 0.085770 Nov 24 16:12:21.825893 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 423/863] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:21 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 21972 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:22.754052 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0fdc56e9-3d8b-4b88-9f6e-8eeb08517175 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:22.754677 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0fdc56e9-3d8b-4b88-9f6e-8eeb08517175 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:22.761063 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0fdc56e9-3d8b-4b88-9f6e-8eeb08517175 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:22.761540 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0fdc56e9-3d8b-4b88-9f6e-8eeb08517175 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:22.762468 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0fdc56e9-3d8b-4b88-9f6e-8eeb08517175 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:22.763037 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0fdc56e9-3d8b-4b88-9f6e-8eeb08517175 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:22.836271 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3760e751-8007-4a49-bd49-8dbc953626d6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:22.837314 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3760e751-8007-4a49-bd49-8dbc953626d6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:22.844211 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3760e751-8007-4a49-bd49-8dbc953626d6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:22.844654 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3760e751-8007-4a49-bd49-8dbc953626d6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:22.845468 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3760e751-8007-4a49-bd49-8dbc953626d6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:22.845906 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3760e751-8007-4a49-bd49-8dbc953626d6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:22.904096 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-0fdc56e9-3d8b-4b88-9f6e-8eeb08517175 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:22.911464 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0fdc56e9-3d8b-4b88-9f6e-8eeb08517175 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1672 microversion: 2.1 time: 0.161133 Nov 24 16:12:22.912047 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 441/864] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:22 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:22.921298 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3760e751-8007-4a49-bd49-8dbc953626d6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 23234 microversion: 2.20 time: 0.088894 Nov 24 16:12:22.921950 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 424/865] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:22 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 23234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:12:23.770490 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-923befd0-34a4-46cd-b73f-1827aaa38d52 req-ae73901d-5c07-4e8d-ba65-e67fe9112c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f67d55-afc9-4ce8-a9c5-8256298c4b7e", "name": "network-vif-deleted", "tag": "1c836e44-a6b1-400d-a64b-3d1e5a65fd29"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:23.773306 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:12:23.773306 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:12:23.782320 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-923befd0-34a4-46cd-b73f-1827aaa38d52 req-ae73901d-5c07-4e8d-ba65-e67fe9112c68 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:23.782910 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-923befd0-34a4-46cd-b73f-1827aaa38d52 req-ae73901d-5c07-4e8d-ba65-e67fe9112c68 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:23.794905 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-923befd0-34a4-46cd-b73f-1827aaa38d52 req-ae73901d-5c07-4e8d-ba65-e67fe9112c68 service nova] Creating event network-vif-deleted:1c836e44-a6b1-400d-a64b-3d1e5a65fd29 for instance 80f67d55-afc9-4ce8-a9c5-8256298c4b7e on hv-cinder-81899 Nov 24 16:12:23.800413 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-923befd0-34a4-46cd-b73f-1827aaa38d52 req-ae73901d-5c07-4e8d-ba65-e67fe9112c68 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033576 Nov 24 16:12:23.801331 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 442/866] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:12:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:12:23.929844 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a343b25c-d867-4e13-8efe-cdb94e2b4d65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:23.930543 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a343b25c-d867-4e13-8efe-cdb94e2b4d65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:23.932615 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fa6ee07c-3842-46b1-836c-1071a07aaf8b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:23.933702 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fa6ee07c-3842-46b1-836c-1071a07aaf8b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:23.938385 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a343b25c-d867-4e13-8efe-cdb94e2b4d65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:23.939128 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a343b25c-d867-4e13-8efe-cdb94e2b4d65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:23.939939 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a343b25c-d867-4e13-8efe-cdb94e2b4d65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:23.940399 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a343b25c-d867-4e13-8efe-cdb94e2b4d65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:23.942268 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fa6ee07c-3842-46b1-836c-1071a07aaf8b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:23.942717 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fa6ee07c-3842-46b1-836c-1071a07aaf8b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:23.943487 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fa6ee07c-3842-46b1-836c-1071a07aaf8b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:23.943915 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fa6ee07c-3842-46b1-836c-1071a07aaf8b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:23.979445 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a343b25c-d867-4e13-8efe-cdb94e2b4d65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:23.980032 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a343b25c-d867-4e13-8efe-cdb94e2b4d65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:23.980756 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-a343b25c-d867-4e13-8efe-cdb94e2b4d65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lazy-loading 'fault' on Instance uuid 80f67d55-afc9-4ce8-a9c5-8256298c4b7e {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:12:24.025607 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fa6ee07c-3842-46b1-836c-1071a07aaf8b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 24818 microversion: 2.20 time: 0.097305 Nov 24 16:12:24.025786 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a343b25c-d867-4e13-8efe-cdb94e2b4d65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:24.026473 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 443/867] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:23 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 24818 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:24.034150 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a343b25c-d867-4e13-8efe-cdb94e2b4d65 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 200 len: 1326 microversion: 2.1 time: 0.108345 Nov 24 16:12:24.034726 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 425/868] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:23 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 1326 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:25.038613 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-341c2c32-7366-45cd-824e-ab5610367347 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:25.039599 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-341c2c32-7366-45cd-824e-ab5610367347 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:25.047502 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-341c2c32-7366-45cd-824e-ab5610367347 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:25.047952 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-341c2c32-7366-45cd-824e-ab5610367347 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:25.048729 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-341c2c32-7366-45cd-824e-ab5610367347 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:25.049193 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-341c2c32-7366-45cd-824e-ab5610367347 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:25.051349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5ef783e4-d055-4dd5-8dc0-8a14bfd278f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:25.051956 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5ef783e4-d055-4dd5-8dc0-8a14bfd278f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:25.058336 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ef783e4-d055-4dd5-8dc0-8a14bfd278f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:25.058781 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ef783e4-d055-4dd5-8dc0-8a14bfd278f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:25.060220 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ef783e4-d055-4dd5-8dc0-8a14bfd278f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:25.060769 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ef783e4-d055-4dd5-8dc0-8a14bfd278f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:25.074095 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-5ef783e4-d055-4dd5-8dc0-8a14bfd278f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] HTTP exception thrown: Instance 80f67d55-afc9-4ce8-a9c5-8256298c4b7e could not be found. Nov 24 16:12:25.074820 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5ef783e4-d055-4dd5-8dc0-8a14bfd278f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Returning 404 to user: Instance 80f67d55-afc9-4ce8-a9c5-8256298c4b7e could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:12:25.075558 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5ef783e4-d055-4dd5-8dc0-8a14bfd278f1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 404 len: 111 microversion: 2.1 time: 0.027882 Nov 24 16:12:25.076109 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 426/869] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:25 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 16:12:25.084022 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-be7b545b-7500-400d-a53c-3e23c4afe5c8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '.version_select at 0x7f361a9fcee0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:25.100971 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-be7b545b-7500-400d-a53c-3e23c4afe5c8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-643994653" status: 202 len: 0 microversion: 2.1 time: 0.020312 Nov 24 16:12:25.101556 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 427/870] 10.222.0.72 () {58 vars in 1217 bytes} [Wed Nov 24 16:12:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-643994653 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:12:25.126074 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-341c2c32-7366-45cd-824e-ab5610367347 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 26401 microversion: 2.20 time: 0.091349 Nov 24 16:12:25.126760 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 444/871] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:25 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 26401 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:25.760847 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5ec5e1eb-ef3e-451b-b086-334b7f750f8e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'create', calling method: .version_select at 0x7f361a99b700>, body: {"keypair": {"name": "tempest-keypair-1900410206"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:25.775813 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-5ec5e1eb-ef3e-451b-b086-334b7f750f8e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Getting quotas for project 1c341b845ae6468b847beba4eee796dd. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:12:25.780089 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-5ec5e1eb-ef3e-451b-b086-334b7f750f8e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Getting quotas for user 6d57401cbd6048c8b02c727520df44e9 and project 1c341b845ae6468b847beba4eee796dd. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:12:26.137878 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7b85e5e9-fc8e-402b-9ade-bfd4b34b3c6b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:26.138866 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7b85e5e9-fc8e-402b-9ade-bfd4b34b3c6b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:26.145723 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7b85e5e9-fc8e-402b-9ade-bfd4b34b3c6b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:26.146164 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7b85e5e9-fc8e-402b-9ade-bfd4b34b3c6b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:26.146974 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7b85e5e9-fc8e-402b-9ade-bfd4b34b3c6b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:26.147386 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7b85e5e9-fc8e-402b-9ade-bfd4b34b3c6b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:26.167218 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-5ec5e1eb-ef3e-451b-b086-334b7f750f8e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Getting quotas for project 1c341b845ae6468b847beba4eee796dd. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:12:26.172138 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-5ec5e1eb-ef3e-451b-b086-334b7f750f8e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Getting quotas for user 6d57401cbd6048c8b02c727520df44e9 and project 1c341b845ae6468b847beba4eee796dd. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:12:26.185676 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5ec5e1eb-ef3e-451b-b086-334b7f750f8e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.428952 Nov 24 16:12:26.186274 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 428/872] 10.222.0.72 () {60 vars in 1157 bytes} [Wed Nov 24 16:12:25 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:26.222182 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7b85e5e9-fc8e-402b-9ade-bfd4b34b3c6b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 27475 microversion: 2.20 time: 0.088344 Nov 24 16:12:26.225914 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 445/873] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:26 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 27475 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:12:27.234960 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5a3f67cb-246e-498b-9a9b-e50a2794c7e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:27.235949 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5a3f67cb-246e-498b-9a9b-e50a2794c7e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:27.241771 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5a3f67cb-246e-498b-9a9b-e50a2794c7e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:27.242216 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5a3f67cb-246e-498b-9a9b-e50a2794c7e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:27.242996 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5a3f67cb-246e-498b-9a9b-e50a2794c7e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:27.243447 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5a3f67cb-246e-498b-9a9b-e50a2794c7e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:27.316842 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5a3f67cb-246e-498b-9a9b-e50a2794c7e0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 27949 microversion: 2.20 time: 0.086604 Nov 24 16:12:27.318004 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 429/874] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:27 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 27949 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:27.486597 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1541697021", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d785b693-1522-4c61-9c47-37993ec7d517"}], "security_groups": [{"name": "tempest-securitygroup--1337909886"}], "key_name": "tempest-keypair-1900410206", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:27.592425 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.network.neutron [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] validate_networks() for [('d785b693-1522-4c61-9c47-37993ec7d517', None, None, None, None, None)] {{(pid=116303) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:12:27.952768 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Flavor limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:12:27.953241 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Image limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:12:27.953715 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Flavor pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:12:27.954123 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Image pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:12:27.954560 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:12:27.963091 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:27.963540 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:27.964354 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:27.964793 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:27.982528 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Getting quotas for project 1c341b845ae6468b847beba4eee796dd. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:12:27.986500 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Getting quotas for user 6d57401cbd6048c8b02c727520df44e9 and project 1c341b845ae6468b847beba4eee796dd. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:12:27.997274 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Going to run 1 instances... {{(pid=116303) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:12:27.999946 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:12:28.046283 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2b529b02-11cf-4885-8f17-b9cf14077a12 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.564009 Nov 24 16:12:28.046867 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 446/875] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:12:27 2021] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:12:28.057126 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0e082bca-08ba-400f-bb7e-a50751ae31e9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:28.057811 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0e082bca-08ba-400f-bb7e-a50751ae31e9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:28.114880 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0e082bca-08ba-400f-bb7e-a50751ae31e9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:28.121342 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0e082bca-08ba-400f-bb7e-a50751ae31e9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1238 microversion: 2.1 time: 0.068175 Nov 24 16:12:28.122570 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 430/876] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:28 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:28.329241 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-69f3f64e-2081-4ea2-8ffa-87e2afac4640 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:28.330293 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-69f3f64e-2081-4ea2-8ffa-87e2afac4640 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:28.336405 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-69f3f64e-2081-4ea2-8ffa-87e2afac4640 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:28.336926 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-69f3f64e-2081-4ea2-8ffa-87e2afac4640 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:28.337816 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-69f3f64e-2081-4ea2-8ffa-87e2afac4640 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:28.338313 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-69f3f64e-2081-4ea2-8ffa-87e2afac4640 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:28.421607 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-69f3f64e-2081-4ea2-8ffa-87e2afac4640 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28186 microversion: 2.20 time: 0.096456 Nov 24 16:12:28.422504 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 447/877] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:28 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:29.138732 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f4409cba-1b69-49f9-b6fe-0a133c2d8cb6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:29.139366 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f4409cba-1b69-49f9-b6fe-0a133c2d8cb6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:29.145727 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f4409cba-1b69-49f9-b6fe-0a133c2d8cb6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:29.146176 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f4409cba-1b69-49f9-b6fe-0a133c2d8cb6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:29.146970 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f4409cba-1b69-49f9-b6fe-0a133c2d8cb6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:29.147412 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f4409cba-1b69-49f9-b6fe-0a133c2d8cb6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:29.217951 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f4409cba-1b69-49f9-b6fe-0a133c2d8cb6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:29.225344 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f4409cba-1b69-49f9-b6fe-0a133c2d8cb6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1296 microversion: 2.1 time: 0.090348 Nov 24 16:12:29.225919 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 431/878] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:29 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1296 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:29.433228 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c6a9a1e6-d4b8-415a-b4ea-15448a6ca856 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:29.434340 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c6a9a1e6-d4b8-415a-b4ea-15448a6ca856 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:29.441350 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c6a9a1e6-d4b8-415a-b4ea-15448a6ca856 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:29.441808 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c6a9a1e6-d4b8-415a-b4ea-15448a6ca856 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:29.442597 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c6a9a1e6-d4b8-415a-b4ea-15448a6ca856 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:29.443030 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c6a9a1e6-d4b8-415a-b4ea-15448a6ca856 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:29.507091 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c6a9a1e6-d4b8-415a-b4ea-15448a6ca856 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28186 microversion: 2.20 time: 0.077794 Nov 24 16:12:29.508670 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 448/879] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:29 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28186 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:30.243655 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-56690346-e4aa-4159-b67a-3a42ba6c9e62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:30.244503 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-56690346-e4aa-4159-b67a-3a42ba6c9e62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:30.251525 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56690346-e4aa-4159-b67a-3a42ba6c9e62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:30.252179 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56690346-e4aa-4159-b67a-3a42ba6c9e62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:30.252988 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56690346-e4aa-4159-b67a-3a42ba6c9e62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:30.253469 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56690346-e4aa-4159-b67a-3a42ba6c9e62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:30.291033 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-8947bb5f-4dc2-40f8-8293-23c415f4c2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8582c22-790a-4760-84f8-78b7929748d3", "tag": "e95db78b-d6c2-46b5-b57f-c37954356d5c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:30.292552 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:12:30.292552 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:12:30.301830 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-8947bb5f-4dc2-40f8-8293-23c415f4c2e1 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:30.302271 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-8947bb5f-4dc2-40f8-8293-23c415f4c2e1 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:30.319954 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-8947bb5f-4dc2-40f8-8293-23c415f4c2e1 service nova] Creating event network-changed:e95db78b-d6c2-46b5-b57f-c37954356d5c for instance c8582c22-790a-4760-84f8-78b7929748d3 on hv-cinder-81899 Nov 24 16:12:30.328124 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-5ee5e1d3-5c8a-4610-8518-b663ec964321 req-8947bb5f-4dc2-40f8-8293-23c415f4c2e1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040768 Nov 24 16:12:30.329423 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 449/880] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:12:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:12:30.484508 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-56690346-e4aa-4159-b67a-3a42ba6c9e62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:30.492251 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-56690346-e4aa-4159-b67a-3a42ba6c9e62 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1364 microversion: 2.1 time: 0.252608 Nov 24 16:12:30.492838 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 432/881] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:30 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:30.520499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e1b92f6b-604f-411b-8667-5f8090a5b3ff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:30.522277 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e1b92f6b-604f-411b-8667-5f8090a5b3ff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:30.528761 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e1b92f6b-604f-411b-8667-5f8090a5b3ff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:30.529164 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e1b92f6b-604f-411b-8667-5f8090a5b3ff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:30.529987 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e1b92f6b-604f-411b-8667-5f8090a5b3ff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:30.530435 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e1b92f6b-604f-411b-8667-5f8090a5b3ff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:30.592765 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e1b92f6b-604f-411b-8667-5f8090a5b3ff tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28186 microversion: 2.20 time: 0.076994 Nov 24 16:12:30.593471 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 450/882] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:30 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28186 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:31.509751 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7631d867-5012-4bde-ba33-d0053abe7089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:31.510292 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7631d867-5012-4bde-ba33-d0053abe7089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:31.518498 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7631d867-5012-4bde-ba33-d0053abe7089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:31.519317 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7631d867-5012-4bde-ba33-d0053abe7089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:31.520165 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7631d867-5012-4bde-ba33-d0053abe7089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:31.520644 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7631d867-5012-4bde-ba33-d0053abe7089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:31.604282 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-004dfeb6-ca83-491d-a4ac-3e1c8fe3aaa6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:31.605475 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-004dfeb6-ca83-491d-a4ac-3e1c8fe3aaa6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:31.613073 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-004dfeb6-ca83-491d-a4ac-3e1c8fe3aaa6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:31.613531 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-004dfeb6-ca83-491d-a4ac-3e1c8fe3aaa6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:31.614322 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-004dfeb6-ca83-491d-a4ac-3e1c8fe3aaa6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:31.614758 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-004dfeb6-ca83-491d-a4ac-3e1c8fe3aaa6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:31.658424 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7631d867-5012-4bde-ba33-d0053abe7089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:31.665834 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7631d867-5012-4bde-ba33-d0053abe7089 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1364 microversion: 2.1 time: 0.159908 Nov 24 16:12:31.666403 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 433/883] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:31 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:31.691232 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-004dfeb6-ca83-491d-a4ac-3e1c8fe3aaa6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28186 microversion: 2.20 time: 0.090857 Nov 24 16:12:31.691873 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 451/884] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:31 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:12:32.682739 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-64fc70c4-869f-48c0-9acf-68d4b7b87fef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:32.683340 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-64fc70c4-869f-48c0-9acf-68d4b7b87fef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:32.689794 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64fc70c4-869f-48c0-9acf-68d4b7b87fef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:32.690238 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64fc70c4-869f-48c0-9acf-68d4b7b87fef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:32.691003 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64fc70c4-869f-48c0-9acf-68d4b7b87fef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:32.691431 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64fc70c4-869f-48c0-9acf-68d4b7b87fef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:32.703879 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d60b469c-744d-4030-bba4-836c74f8a98a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:32.704865 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d60b469c-744d-4030-bba4-836c74f8a98a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:32.711764 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d60b469c-744d-4030-bba4-836c74f8a98a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:32.712214 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d60b469c-744d-4030-bba4-836c74f8a98a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:32.713000 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d60b469c-744d-4030-bba4-836c74f8a98a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:32.713463 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d60b469c-744d-4030-bba4-836c74f8a98a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:32.776617 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d60b469c-744d-4030-bba4-836c74f8a98a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28186 microversion: 2.20 time: 0.077310 Nov 24 16:12:32.778119 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 452/885] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:32 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28186 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:12:32.827224 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-64fc70c4-869f-48c0-9acf-68d4b7b87fef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:32.834848 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-64fc70c4-869f-48c0-9acf-68d4b7b87fef tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1364 microversion: 2.1 time: 0.155789 Nov 24 16:12:32.835417 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 434/886] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:32 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:33.788330 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fd8fd9c8-8d32-43c0-98f3-790074bc8210 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:33.789364 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fd8fd9c8-8d32-43c0-98f3-790074bc8210 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:33.797120 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fd8fd9c8-8d32-43c0-98f3-790074bc8210 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:33.797567 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fd8fd9c8-8d32-43c0-98f3-790074bc8210 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:33.798348 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fd8fd9c8-8d32-43c0-98f3-790074bc8210 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:33.798780 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fd8fd9c8-8d32-43c0-98f3-790074bc8210 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:33.851535 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d696cce3-f98d-4585-8c74-4b77a0daacb4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:33.852141 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d696cce3-f98d-4585-8c74-4b77a0daacb4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:33.858763 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fd8fd9c8-8d32-43c0-98f3-790074bc8210 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28186 microversion: 2.20 time: 0.074350 Nov 24 16:12:33.862636 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 453/887] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:33 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28186 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:33.862798 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d696cce3-f98d-4585-8c74-4b77a0daacb4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:33.862798 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d696cce3-f98d-4585-8c74-4b77a0daacb4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:33.862798 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d696cce3-f98d-4585-8c74-4b77a0daacb4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:33.862798 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d696cce3-f98d-4585-8c74-4b77a0daacb4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:33.991970 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d696cce3-f98d-4585-8c74-4b77a0daacb4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:34.000169 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d696cce3-f98d-4585-8c74-4b77a0daacb4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1364 microversion: 2.1 time: 0.152353 Nov 24 16:12:34.000743 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 435/888] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:33 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:12:34.870771 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-06facd98-bbea-4b7b-bc00-9719b7173bc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:34.872502 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-06facd98-bbea-4b7b-bc00-9719b7173bc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:34.879778 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-06facd98-bbea-4b7b-bc00-9719b7173bc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:34.880216 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-06facd98-bbea-4b7b-bc00-9719b7173bc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:34.880992 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-06facd98-bbea-4b7b-bc00-9719b7173bc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:34.881450 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-06facd98-bbea-4b7b-bc00-9719b7173bc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:34.948143 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-06facd98-bbea-4b7b-bc00-9719b7173bc5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28186 microversion: 2.20 time: 0.081198 Nov 24 16:12:34.952751 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 454/889] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:34 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28186 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:35.017721 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a6a07418-2972-4852-b147-049b68f3d8e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:35.018283 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a6a07418-2972-4852-b147-049b68f3d8e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:35.024510 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a6a07418-2972-4852-b147-049b68f3d8e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:35.025012 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a6a07418-2972-4852-b147-049b68f3d8e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:35.025840 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a6a07418-2972-4852-b147-049b68f3d8e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:35.026279 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a6a07418-2972-4852-b147-049b68f3d8e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:35.156269 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a6a07418-2972-4852-b147-049b68f3d8e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:35.163706 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a6a07418-2972-4852-b147-049b68f3d8e3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1364 microversion: 2.1 time: 0.149822 Nov 24 16:12:35.164279 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 436/890] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:35 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:12:35.960489 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7ffe7b35-2b37-45be-b991-32ba9a724f5d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:35.961492 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7ffe7b35-2b37-45be-b991-32ba9a724f5d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:35.968858 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7ffe7b35-2b37-45be-b991-32ba9a724f5d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:35.969319 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7ffe7b35-2b37-45be-b991-32ba9a724f5d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:35.970091 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7ffe7b35-2b37-45be-b991-32ba9a724f5d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:35.970521 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7ffe7b35-2b37-45be-b991-32ba9a724f5d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:36.041567 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7ffe7b35-2b37-45be-b991-32ba9a724f5d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28186 microversion: 2.20 time: 0.084924 Nov 24 16:12:36.042226 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 455/891] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:35 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28186 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:36.180025 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0bc2664a-f1b2-43cd-9438-d76ef5a79c0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:36.180633 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0bc2664a-f1b2-43cd-9438-d76ef5a79c0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:36.187270 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0bc2664a-f1b2-43cd-9438-d76ef5a79c0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:36.187725 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0bc2664a-f1b2-43cd-9438-d76ef5a79c0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:36.188537 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0bc2664a-f1b2-43cd-9438-d76ef5a79c0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:36.189005 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0bc2664a-f1b2-43cd-9438-d76ef5a79c0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:36.330447 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0bc2664a-f1b2-43cd-9438-d76ef5a79c0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:36.338424 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0bc2664a-f1b2-43cd-9438-d76ef5a79c0d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1364 microversion: 2.1 time: 0.161952 Nov 24 16:12:36.339398 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 437/892] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:36 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:36.934834 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-9d95e9dc-e411-4202-963c-ef660e1a4d44 req-eea7b481-ce99-491a-a234-262873e39c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8582c22-790a-4760-84f8-78b7929748d3", "name": "network-vif-plugged", "status": "completed", "tag": "e95db78b-d6c2-46b5-b57f-c37954356d5c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:36.937721 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:12:36.937721 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:12:36.950799 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-9d95e9dc-e411-4202-963c-ef660e1a4d44 req-eea7b481-ce99-491a-a234-262873e39c9f service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:36.951372 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-9d95e9dc-e411-4202-963c-ef660e1a4d44 req-eea7b481-ce99-491a-a234-262873e39c9f service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:36.962355 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-9d95e9dc-e411-4202-963c-ef660e1a4d44 req-eea7b481-ce99-491a-a234-262873e39c9f service nova] Creating event network-vif-plugged:e95db78b-d6c2-46b5-b57f-c37954356d5c for instance c8582c22-790a-4760-84f8-78b7929748d3 on hv-cinder-81899 Nov 24 16:12:36.967381 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-9d95e9dc-e411-4202-963c-ef660e1a4d44 req-eea7b481-ce99-491a-a234-262873e39c9f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037444 Nov 24 16:12:36.967982 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 456/893] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:12:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:12:37.054091 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a3b67477-78e4-45f5-859c-12a47b6fc8ba tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:37.055000 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a3b67477-78e4-45f5-859c-12a47b6fc8ba tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:37.062216 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3b67477-78e4-45f5-859c-12a47b6fc8ba tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:37.062679 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3b67477-78e4-45f5-859c-12a47b6fc8ba tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:37.063486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3b67477-78e4-45f5-859c-12a47b6fc8ba tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:37.064022 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3b67477-78e4-45f5-859c-12a47b6fc8ba tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:37.132525 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a3b67477-78e4-45f5-859c-12a47b6fc8ba tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28186 microversion: 2.20 time: 0.081896 Nov 24 16:12:37.133406 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 438/894] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:37 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:37.356765 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-01ed4d4e-21ac-4d7f-b434-b2aec8aeea07 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:37.357409 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-01ed4d4e-21ac-4d7f-b434-b2aec8aeea07 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:37.363866 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-01ed4d4e-21ac-4d7f-b434-b2aec8aeea07 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:37.364309 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-01ed4d4e-21ac-4d7f-b434-b2aec8aeea07 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:37.365116 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-01ed4d4e-21ac-4d7f-b434-b2aec8aeea07 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:37.365554 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-01ed4d4e-21ac-4d7f-b434-b2aec8aeea07 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:37.512417 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-01ed4d4e-21ac-4d7f-b434-b2aec8aeea07 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:37.519726 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-01ed4d4e-21ac-4d7f-b434-b2aec8aeea07 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1364 microversion: 2.1 time: 0.167691 Nov 24 16:12:37.520301 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 457/895] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:37 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:38.144384 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-66402d6d-43d8-48ba-8a19-d941967a0aaa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:38.145417 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-66402d6d-43d8-48ba-8a19-d941967a0aaa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:38.152237 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66402d6d-43d8-48ba-8a19-d941967a0aaa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:38.152683 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66402d6d-43d8-48ba-8a19-d941967a0aaa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:38.153479 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66402d6d-43d8-48ba-8a19-d941967a0aaa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:38.153919 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66402d6d-43d8-48ba-8a19-d941967a0aaa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:38.217648 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-66402d6d-43d8-48ba-8a19-d941967a0aaa tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28186 microversion: 2.20 time: 0.077112 Nov 24 16:12:38.218293 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 439/896] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:38 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28186 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:38.536785 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c721be1f-305a-4475-9ffd-1f2ebf94f233 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:38.537446 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c721be1f-305a-4475-9ffd-1f2ebf94f233 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:38.544636 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c721be1f-305a-4475-9ffd-1f2ebf94f233 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:38.545276 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c721be1f-305a-4475-9ffd-1f2ebf94f233 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:38.546194 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c721be1f-305a-4475-9ffd-1f2ebf94f233 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:38.546693 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c721be1f-305a-4475-9ffd-1f2ebf94f233 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:38.684439 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c721be1f-305a-4475-9ffd-1f2ebf94f233 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:38.691753 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c721be1f-305a-4475-9ffd-1f2ebf94f233 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1364 microversion: 2.1 time: 0.158588 Nov 24 16:12:38.692311 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 458/897] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:38 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:39.229601 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5477f136-52dd-4878-b3b5-9f57a53397de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:39.231337 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5477f136-52dd-4878-b3b5-9f57a53397de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:39.238245 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5477f136-52dd-4878-b3b5-9f57a53397de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:39.238692 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5477f136-52dd-4878-b3b5-9f57a53397de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:39.239474 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5477f136-52dd-4878-b3b5-9f57a53397de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:39.239910 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5477f136-52dd-4878-b3b5-9f57a53397de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:39.304166 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5477f136-52dd-4878-b3b5-9f57a53397de tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28186 microversion: 2.20 time: 0.078567 Nov 24 16:12:39.304812 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 440/898] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:39 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28186 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:39.708572 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3dbadeb9-b7ae-41e8-805b-062939ab061f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:39.709226 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3dbadeb9-b7ae-41e8-805b-062939ab061f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:39.716069 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3dbadeb9-b7ae-41e8-805b-062939ab061f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:39.716517 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3dbadeb9-b7ae-41e8-805b-062939ab061f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:39.717320 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3dbadeb9-b7ae-41e8-805b-062939ab061f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:39.717756 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3dbadeb9-b7ae-41e8-805b-062939ab061f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:39.850812 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3dbadeb9-b7ae-41e8-805b-062939ab061f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:39.859016 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3dbadeb9-b7ae-41e8-805b-062939ab061f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1550 microversion: 2.1 time: 0.154019 Nov 24 16:12:39.859580 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 459/899] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:39 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:39.876458 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fced5e06-3bb7-4c83-8c94-6f4d847abc3c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:39.877087 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fced5e06-3bb7-4c83-8c94-6f4d847abc3c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:39.883849 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fced5e06-3bb7-4c83-8c94-6f4d847abc3c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:39.884319 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fced5e06-3bb7-4c83-8c94-6f4d847abc3c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:39.885125 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fced5e06-3bb7-4c83-8c94-6f4d847abc3c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:39.885554 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fced5e06-3bb7-4c83-8c94-6f4d847abc3c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:39.965379 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fced5e06-3bb7-4c83-8c94-6f4d847abc3c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092452 Nov 24 16:12:39.966041 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 441/900] 10.222.0.72 () {58 vars in 1274 bytes} [Wed Nov 24 16:12:39 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:12:40.315646 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-41294747-e8a7-491e-b997-41fd5a6d9ef3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:40.316544 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-41294747-e8a7-491e-b997-41fd5a6d9ef3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:40.323168 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-41294747-e8a7-491e-b997-41fd5a6d9ef3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:40.323676 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-41294747-e8a7-491e-b997-41fd5a6d9ef3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:40.325133 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-41294747-e8a7-491e-b997-41fd5a6d9ef3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:40.325563 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-41294747-e8a7-491e-b997-41fd5a6d9ef3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:40.385470 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-41294747-e8a7-491e-b997-41fd5a6d9ef3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28186 microversion: 2.20 time: 0.073284 Nov 24 16:12:40.390220 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 460/901] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:40 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28186 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:40.640901 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-92771a05-df5d-4f0f-a433-eeb0fd58537c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1392222549"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:40.641512 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-92771a05-df5d-4f0f-a433-eeb0fd58537c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:40.647260 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-92771a05-df5d-4f0f-a433-eeb0fd58537c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:40.647703 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-92771a05-df5d-4f0f-a433-eeb0fd58537c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:40.648489 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-92771a05-df5d-4f0f-a433-eeb0fd58537c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:40.648919 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-92771a05-df5d-4f0f-a433-eeb0fd58537c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:40.830413 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.network.security_group_api [None req-92771a05-df5d-4f0f-a433-eeb0fd58537c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Removing security group 497983bf-eca9-465b-ad1a-9718733e64c7 from port fe858985-c82e-488e-aceb-25ed4bffc8ee Nov 24 16:12:41.077529 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8109588c-d396-40a5-81eb-107ce8efb9dc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:41.078638 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8109588c-d396-40a5-81eb-107ce8efb9dc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:41.085903 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8109588c-d396-40a5-81eb-107ce8efb9dc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:41.086476 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8109588c-d396-40a5-81eb-107ce8efb9dc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:41.087375 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8109588c-d396-40a5-81eb-107ce8efb9dc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:41.087979 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8109588c-d396-40a5-81eb-107ce8efb9dc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:41.147899 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8109588c-d396-40a5-81eb-107ce8efb9dc tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 14 microversion: 2.1 time: 0.074959 Nov 24 16:12:41.151431 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 461/902] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:41 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 16:12:41.154146 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-fd923471-1886-430a-a2fa-92605b8c63b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8582c22-790a-4760-84f8-78b7929748d3", "tag": "e95db78b-d6c2-46b5-b57f-c37954356d5c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:41.155639 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:12:41.155639 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:12:41.163254 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-fd923471-1886-430a-a2fa-92605b8c63b0 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:41.163699 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-fd923471-1886-430a-a2fa-92605b8c63b0 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:41.180363 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-fd923471-1886-430a-a2fa-92605b8c63b0 service nova] Creating event network-changed:e95db78b-d6c2-46b5-b57f-c37954356d5c for instance c8582c22-790a-4760-84f8-78b7929748d3 on hv-cinder-81899 Nov 24 16:12:41.186172 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-b5c6e4d8-31c3-43ce-9c88-9a633d728e4e req-fd923471-1886-430a-a2fa-92605b8c63b0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036240 Nov 24 16:12:41.187012 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 462/903] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:12:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:12:41.334692 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-92771a05-df5d-4f0f-a433-eeb0fd58537c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "POST /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/action" status: 202 len: 0 microversion: 2.1 time: 0.698489 Nov 24 16:12:41.335917 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 442/904] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:40 2021] POST /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/action => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:41.400029 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6c8a137c-421f-470b-b4ff-de4770cad990 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:41.412868 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6c8a137c-421f-470b-b4ff-de4770cad990 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:41.428418 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6c8a137c-421f-470b-b4ff-de4770cad990 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:41.428878 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6c8a137c-421f-470b-b4ff-de4770cad990 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:41.429955 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6c8a137c-421f-470b-b4ff-de4770cad990 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:41.430154 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6c8a137c-421f-470b-b4ff-de4770cad990 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:41.540984 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6c8a137c-421f-470b-b4ff-de4770cad990 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28477 microversion: 2.20 time: 0.145888 Nov 24 16:12:41.542130 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 463/905] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:41 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28477 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:42.159600 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-72242cba-6c0f-485b-a9b4-a5383163f251 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:42.160571 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-72242cba-6c0f-485b-a9b4-a5383163f251 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:42.166733 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-72242cba-6c0f-485b-a9b4-a5383163f251 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:42.167415 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-72242cba-6c0f-485b-a9b4-a5383163f251 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:42.169315 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-72242cba-6c0f-485b-a9b4-a5383163f251 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:42.169761 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-72242cba-6c0f-485b-a9b4-a5383163f251 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:42.250922 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-72242cba-6c0f-485b-a9b4-a5383163f251 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 14 microversion: 2.1 time: 0.094435 Nov 24 16:12:42.251918 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 443/906] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:42 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:12:42.554042 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6f1f8d48-7295-48db-ab77-124804a884cc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:42.555846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6f1f8d48-7295-48db-ab77-124804a884cc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:42.562835 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6f1f8d48-7295-48db-ab77-124804a884cc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:42.563182 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6f1f8d48-7295-48db-ab77-124804a884cc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:42.564171 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6f1f8d48-7295-48db-ab77-124804a884cc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:42.564807 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6f1f8d48-7295-48db-ab77-124804a884cc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:42.630937 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6f1f8d48-7295-48db-ab77-124804a884cc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28477 microversion: 2.20 time: 0.080911 Nov 24 16:12:42.631602 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 464/907] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:42 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28477 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:42.883563 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-eed5a1d9-f52d-45a8-8f2a-7c98aed7765d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:42.884141 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-eed5a1d9-f52d-45a8-8f2a-7c98aed7765d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:42.891941 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eed5a1d9-f52d-45a8-8f2a-7c98aed7765d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:42.892386 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eed5a1d9-f52d-45a8-8f2a-7c98aed7765d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:42.893216 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eed5a1d9-f52d-45a8-8f2a-7c98aed7765d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:42.893656 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-eed5a1d9-f52d-45a8-8f2a-7c98aed7765d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:42.985940 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-eed5a1d9-f52d-45a8-8f2a-7c98aed7765d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lazy-loading 'services' on Instance uuid 47f17e69-ba46-4a11-8bfb-01e444817ac1 {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:12:43.061279 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-eed5a1d9-f52d-45a8-8f2a-7c98aed7765d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "DELETE /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/os-volume_attachments/877c7a1f-320b-4ed5-a3ac-c63b334cb95b" status: 202 len: 0 microversion: 2.1 time: 0.181472 Nov 24 16:12:43.062174 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 444/908] 10.222.0.72 () {58 vars in 1415 bytes} [Wed Nov 24 16:12:42 2021] DELETE /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/os-volume_attachments/877c7a1f-320b-4ed5-a3ac-c63b334cb95b => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:43.070742 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-db6b5120-f37f-4851-8935-35e90557bd40 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:43.071911 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-db6b5120-f37f-4851-8935-35e90557bd40 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:43.079318 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-db6b5120-f37f-4851-8935-35e90557bd40 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:43.079807 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-db6b5120-f37f-4851-8935-35e90557bd40 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:43.080568 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-db6b5120-f37f-4851-8935-35e90557bd40 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:43.081002 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-db6b5120-f37f-4851-8935-35e90557bd40 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:43.114790 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-db6b5120-f37f-4851-8935-35e90557bd40 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048064 Nov 24 16:12:43.115470 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 465/909] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:12:43 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:12:43.203231 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-11c328ae-c09c-44a0-917a-abf294e53e73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee"}, {"name": "network-changed", "server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:43.204822 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:12:43.204822 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:12:43.216542 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-11c328ae-c09c-44a0-917a-abf294e53e73 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:43.216982 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-11c328ae-c09c-44a0-917a-abf294e53e73 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:43.229356 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-11c328ae-c09c-44a0-917a-abf294e53e73 service nova] Creating event network-changed:fe858985-c82e-488e-aceb-25ed4bffc8ee for instance 47f17e69-ba46-4a11-8bfb-01e444817ac1 on hv-cinder-81899 Nov 24 16:12:43.229888 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-11c328ae-c09c-44a0-917a-abf294e53e73 service nova] Creating event network-changed:fe858985-c82e-488e-aceb-25ed4bffc8ee for instance 47f17e69-ba46-4a11-8bfb-01e444817ac1 on hv-cinder-81899 Nov 24 16:12:43.235106 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-264782b9-dbb6-4fcc-a150-45d20598cc8c req-11c328ae-c09c-44a0-917a-abf294e53e73 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036481 Nov 24 16:12:43.236150 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 445/910] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:12:43 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:12:43.260818 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7d0eb1e5-9a4f-4e9b-b821-8e6c004e72d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:43.262639 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7d0eb1e5-9a4f-4e9b-b821-8e6c004e72d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:43.269075 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7d0eb1e5-9a4f-4e9b-b821-8e6c004e72d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:43.269605 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7d0eb1e5-9a4f-4e9b-b821-8e6c004e72d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:43.270454 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7d0eb1e5-9a4f-4e9b-b821-8e6c004e72d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:43.271063 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7d0eb1e5-9a4f-4e9b-b821-8e6c004e72d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:43.368088 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7d0eb1e5-9a4f-4e9b-b821-8e6c004e72d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 14 microversion: 2.1 time: 0.110740 Nov 24 16:12:43.368736 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 466/911] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:43 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:12:43.646841 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b9550b3e-8363-4935-b323-fd1200332bb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:43.648465 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b9550b3e-8363-4935-b323-fd1200332bb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:43.659945 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b9550b3e-8363-4935-b323-fd1200332bb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:43.660450 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b9550b3e-8363-4935-b323-fd1200332bb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:43.661570 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b9550b3e-8363-4935-b323-fd1200332bb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:43.662007 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b9550b3e-8363-4935-b323-fd1200332bb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:43.759765 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b9550b3e-8363-4935-b323-fd1200332bb8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.118920 Nov 24 16:12:43.760464 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 446/912] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:43 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:44.128173 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-31d4d92f-af90-4b5a-8cfe-4d17761596ca tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:44.129217 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-31d4d92f-af90-4b5a-8cfe-4d17761596ca tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:44.136164 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-31d4d92f-af90-4b5a-8cfe-4d17761596ca tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:44.136616 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-31d4d92f-af90-4b5a-8cfe-4d17761596ca tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:44.137497 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-31d4d92f-af90-4b5a-8cfe-4d17761596ca tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:44.137926 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-31d4d92f-af90-4b5a-8cfe-4d17761596ca tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:44.168141 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-31d4d92f-af90-4b5a-8cfe-4d17761596ca tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043462 Nov 24 16:12:44.168791 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 467/913] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:12:44 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:12:44.179022 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fa865843-b35b-4f2d-bbff-9d07bedf7b8c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:44.179873 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fa865843-b35b-4f2d-bbff-9d07bedf7b8c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:44.187059 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa865843-b35b-4f2d-bbff-9d07bedf7b8c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:44.187500 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa865843-b35b-4f2d-bbff-9d07bedf7b8c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:44.188278 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa865843-b35b-4f2d-bbff-9d07bedf7b8c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:44.188707 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa865843-b35b-4f2d-bbff-9d07bedf7b8c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:44.266520 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-fa865843-b35b-4f2d-bbff-9d07bedf7b8c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] HTTP exception thrown: Instance 47f17e69-ba46-4a11-8bfb-01e444817ac1 is not attached to volume 877c7a1f-320b-4ed5-a3ac-c63b334cb95b Nov 24 16:12:44.267891 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fa865843-b35b-4f2d-bbff-9d07bedf7b8c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Returning 404 to user: Instance 47f17e69-ba46-4a11-8bfb-01e444817ac1 is not attached to volume 877c7a1f-320b-4ed5-a3ac-c63b334cb95b {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:12:44.268820 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fa865843-b35b-4f2d-bbff-9d07bedf7b8c tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "DELETE /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/os-volume_attachments/877c7a1f-320b-4ed5-a3ac-c63b334cb95b" status: 404 len: 154 microversion: 2.1 time: 0.093980 Nov 24 16:12:44.269427 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 447/914] 10.222.0.72 () {58 vars in 1415 bytes} [Wed Nov 24 16:12:44 2021] DELETE /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1/os-volume_attachments/877c7a1f-320b-4ed5-a3ac-c63b334cb95b => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:12:44.379786 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ea9ffc97-27bb-4ccc-9451-e17285a33473 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:44.380714 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ea9ffc97-27bb-4ccc-9451-e17285a33473 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:44.387595 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ea9ffc97-27bb-4ccc-9451-e17285a33473 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:44.388047 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ea9ffc97-27bb-4ccc-9451-e17285a33473 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:44.388825 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ea9ffc97-27bb-4ccc-9451-e17285a33473 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:44.389299 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ea9ffc97-27bb-4ccc-9451-e17285a33473 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:44.448026 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ea9ffc97-27bb-4ccc-9451-e17285a33473 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 14 microversion: 2.1 time: 0.071816 Nov 24 16:12:44.448691 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 468/915] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:44 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:12:44.772068 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a74da42b-06cf-4185-9807-55994e566b8e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:44.772974 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a74da42b-06cf-4185-9807-55994e566b8e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:44.780844 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a74da42b-06cf-4185-9807-55994e566b8e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:44.781322 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a74da42b-06cf-4185-9807-55994e566b8e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:44.782106 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a74da42b-06cf-4185-9807-55994e566b8e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:44.782543 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a74da42b-06cf-4185-9807-55994e566b8e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:44.850716 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a74da42b-06cf-4185-9807-55994e566b8e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.082082 Nov 24 16:12:44.851269 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 448/916] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:44 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:45.401576 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-82b0a679-314a-411c-a73a-1537f97b7572 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:45.402895 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-82b0a679-314a-411c-a73a-1537f97b7572 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:45.409695 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-82b0a679-314a-411c-a73a-1537f97b7572 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:45.410134 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-82b0a679-314a-411c-a73a-1537f97b7572 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:45.410904 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-82b0a679-314a-411c-a73a-1537f97b7572 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:45.411334 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-82b0a679-314a-411c-a73a-1537f97b7572 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:45.435514 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-82b0a679-314a-411c-a73a-1537f97b7572 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Going to try to terminate instance {{(pid=116303) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:12:45.459157 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-62b61545-f339-46d5-b4d3-d0693ce1267d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:45.460186 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-62b61545-f339-46d5-b4d3-d0693ce1267d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:45.468164 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-62b61545-f339-46d5-b4d3-d0693ce1267d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:45.468561 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-62b61545-f339-46d5-b4d3-d0693ce1267d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:45.469389 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-62b61545-f339-46d5-b4d3-d0693ce1267d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:45.469831 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-62b61545-f339-46d5-b4d3-d0693ce1267d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:45.516821 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-82b0a679-314a-411c-a73a-1537f97b7572 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "DELETE /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 204 len: 0 microversion: 2.1 time: 0.118969 Nov 24 16:12:45.517427 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 469/917] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:12:45 2021] DELETE /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:12:45.525816 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1515ef04-42fd-4b71-84a5-8800b624a612 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:45.526499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1515ef04-42fd-4b71-84a5-8800b624a612 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:45.537851 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1515ef04-42fd-4b71-84a5-8800b624a612 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:45.538293 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1515ef04-42fd-4b71-84a5-8800b624a612 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:45.539077 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1515ef04-42fd-4b71-84a5-8800b624a612 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:45.539512 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1515ef04-42fd-4b71-84a5-8800b624a612 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:45.544282 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-62b61545-f339-46d5-b4d3-d0693ce1267d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 14 microversion: 2.1 time: 0.088685 Nov 24 16:12:45.547534 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 449/918] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:45 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 16:12:45.681295 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1515ef04-42fd-4b71-84a5-8800b624a612 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:45.689084 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1515ef04-42fd-4b71-84a5-8800b624a612 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1556 microversion: 2.1 time: 0.167113 Nov 24 16:12:45.689652 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 470/919] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:45 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:12:45.863183 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d8197c2b-19a2-4c14-99ec-bedc427f0194 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:45.864073 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d8197c2b-19a2-4c14-99ec-bedc427f0194 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:45.871406 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d8197c2b-19a2-4c14-99ec-bedc427f0194 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:45.871840 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d8197c2b-19a2-4c14-99ec-bedc427f0194 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:45.872874 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d8197c2b-19a2-4c14-99ec-bedc427f0194 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:45.873333 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d8197c2b-19a2-4c14-99ec-bedc427f0194 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:45.942213 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d8197c2b-19a2-4c14-99ec-bedc427f0194 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.082978 Nov 24 16:12:45.943117 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 450/920] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:45 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:46.555491 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-26b8eaa7-7198-4083-81d0-95b8cbd06178 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:46.556336 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-26b8eaa7-7198-4083-81d0-95b8cbd06178 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:46.563022 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-26b8eaa7-7198-4083-81d0-95b8cbd06178 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:46.563500 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-26b8eaa7-7198-4083-81d0-95b8cbd06178 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:46.564315 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-26b8eaa7-7198-4083-81d0-95b8cbd06178 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:46.564747 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-26b8eaa7-7198-4083-81d0-95b8cbd06178 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:46.626300 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-26b8eaa7-7198-4083-81d0-95b8cbd06178 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 14 microversion: 2.1 time: 0.074456 Nov 24 16:12:46.627007 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 471/921] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:46 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:12:46.707462 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-92b60573-8755-401f-b77b-daea1238fc50 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:46.708143 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-92b60573-8755-401f-b77b-daea1238fc50 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:46.715459 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-92b60573-8755-401f-b77b-daea1238fc50 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:46.715895 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-92b60573-8755-401f-b77b-daea1238fc50 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:46.716659 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-92b60573-8755-401f-b77b-daea1238fc50 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:46.717116 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-92b60573-8755-401f-b77b-daea1238fc50 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:46.848746 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-92b60573-8755-401f-b77b-daea1238fc50 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:46.856665 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-92b60573-8755-401f-b77b-daea1238fc50 tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1556 microversion: 2.1 time: 0.153198 Nov 24 16:12:46.857273 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 451/922] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:46 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:12:46.955079 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9e4809ac-15fb-4e08-b0a9-da489ed9ffb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:46.956060 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9e4809ac-15fb-4e08-b0a9-da489ed9ffb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:46.962804 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9e4809ac-15fb-4e08-b0a9-da489ed9ffb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:46.963248 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9e4809ac-15fb-4e08-b0a9-da489ed9ffb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:46.964041 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9e4809ac-15fb-4e08-b0a9-da489ed9ffb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:46.965227 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9e4809ac-15fb-4e08-b0a9-da489ed9ffb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:47.029522 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9e4809ac-15fb-4e08-b0a9-da489ed9ffb7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.078266 Nov 24 16:12:47.030153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 472/923] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:46 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:47.637762 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a5894059-a11b-4987-9655-5c61612eadb7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:47.638738 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a5894059-a11b-4987-9655-5c61612eadb7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:47.645150 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a5894059-a11b-4987-9655-5c61612eadb7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:47.645602 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a5894059-a11b-4987-9655-5c61612eadb7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:47.646397 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a5894059-a11b-4987-9655-5c61612eadb7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:47.646833 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a5894059-a11b-4987-9655-5c61612eadb7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:47.706538 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a5894059-a11b-4987-9655-5c61612eadb7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 14 microversion: 2.1 time: 0.072330 Nov 24 16:12:47.707181 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 452/924] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:47 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:12:47.860943 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-e7d276c2-9d2a-4173-a3bf-5dd942b06310 req-77106041-a431-4208-889a-44e0f15ada24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f17e69-ba46-4a11-8bfb-01e444817ac1", "name": "network-vif-deleted", "tag": "fe858985-c82e-488e-aceb-25ed4bffc8ee"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:47.862697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:12:47.862697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:12:47.876530 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ac83ae2a-a837-4c49-b1ae-f680590cbe9f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:47.877431 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ac83ae2a-a837-4c49-b1ae-f680590cbe9f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:47.882469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-e7d276c2-9d2a-4173-a3bf-5dd942b06310 req-77106041-a431-4208-889a-44e0f15ada24 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:47.882982 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-e7d276c2-9d2a-4173-a3bf-5dd942b06310 req-77106041-a431-4208-889a-44e0f15ada24 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:47.884963 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac83ae2a-a837-4c49-b1ae-f680590cbe9f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:47.885771 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac83ae2a-a837-4c49-b1ae-f680590cbe9f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:47.886684 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac83ae2a-a837-4c49-b1ae-f680590cbe9f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:47.887134 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac83ae2a-a837-4c49-b1ae-f680590cbe9f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:47.896134 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-e7d276c2-9d2a-4173-a3bf-5dd942b06310 req-77106041-a431-4208-889a-44e0f15ada24 service nova] Creating event network-vif-deleted:fe858985-c82e-488e-aceb-25ed4bffc8ee for instance 47f17e69-ba46-4a11-8bfb-01e444817ac1 on hv-cinder-81899 Nov 24 16:12:47.900927 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-e7d276c2-9d2a-4173-a3bf-5dd942b06310 req-77106041-a431-4208-889a-44e0f15ada24 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044480 Nov 24 16:12:47.902495 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 473/925] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:12:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:12:47.980861 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ac83ae2a-a837-4c49-b1ae-f680590cbe9f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccb8066ce5d49749aeef36b04e71942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b09c1b1b2994015967d00aba299005b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:12:47.990058 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ac83ae2a-a837-4c49-b1ae-f680590cbe9f tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 200 len: 1344 microversion: 2.1 time: 0.118085 Nov 24 16:12:47.990663 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 453/926] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:47 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 1344 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:12:48.043106 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-925f3ae5-72b7-45b5-999c-b07606fea375 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:48.044036 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-925f3ae5-72b7-45b5-999c-b07606fea375 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:48.050508 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-925f3ae5-72b7-45b5-999c-b07606fea375 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:48.050954 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-925f3ae5-72b7-45b5-999c-b07606fea375 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:48.051749 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-925f3ae5-72b7-45b5-999c-b07606fea375 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:48.052185 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-925f3ae5-72b7-45b5-999c-b07606fea375 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:48.120169 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-925f3ae5-72b7-45b5-999c-b07606fea375 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.082184 Nov 24 16:12:48.120947 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 474/927] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:48 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:48.718164 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-90fa5c03-24bb-41aa-8f48-e438b71871bb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:48.719068 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-90fa5c03-24bb-41aa-8f48-e438b71871bb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:48.725318 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90fa5c03-24bb-41aa-8f48-e438b71871bb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:48.725761 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90fa5c03-24bb-41aa-8f48-e438b71871bb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:48.726534 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90fa5c03-24bb-41aa-8f48-e438b71871bb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:48.726960 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-90fa5c03-24bb-41aa-8f48-e438b71871bb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:48.788093 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-90fa5c03-24bb-41aa-8f48-e438b71871bb tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 14 microversion: 2.1 time: 0.073523 Nov 24 16:12:48.788974 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 454/928] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:48 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 16:12:49.008671 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f6e6ef52-c3e1-4209-a677-6b2aea26136d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:49.009402 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f6e6ef52-c3e1-4209-a677-6b2aea26136d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] [instance: 47f17e69-ba46-4a11-8bfb-01e444817ac1] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:49.016620 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f6e6ef52-c3e1-4209-a677-6b2aea26136d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:49.017106 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f6e6ef52-c3e1-4209-a677-6b2aea26136d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:49.017924 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f6e6ef52-c3e1-4209-a677-6b2aea26136d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:49.018393 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f6e6ef52-c3e1-4209-a677-6b2aea26136d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:49.033497 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-f6e6ef52-c3e1-4209-a677-6b2aea26136d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] HTTP exception thrown: Instance 47f17e69-ba46-4a11-8bfb-01e444817ac1 could not be found. Nov 24 16:12:49.034107 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f6e6ef52-c3e1-4209-a677-6b2aea26136d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Returning 404 to user: Instance 47f17e69-ba46-4a11-8bfb-01e444817ac1 could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:12:49.034946 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f6e6ef52-c3e1-4209-a677-6b2aea26136d tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1" status: 404 len: 111 microversion: 2.1 time: 0.030481 Nov 24 16:12:49.035510 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 475/929] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:12:49 2021] GET /compute/v2.1/servers/47f17e69-ba46-4a11-8bfb-01e444817ac1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 16:12:49.044917 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3d5fbcc9-519a-4131-8849-bad21efd662a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] Calling method '.version_select at 0x7f361a9fca60>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:12:49.064414 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3d5fbcc9-519a-4131-8849-bad21efd662a tempest-TestMinimumBasicScenario-388436043 tempest-TestMinimumBasicScenario-388436043-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1115653760" status: 202 len: 0 microversion: 2.1 time: 0.024084 Nov 24 16:12:49.065054 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 455/930] 10.222.0.72 () {58 vars in 1271 bytes} [Wed Nov 24 16:12:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1115653760 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:12:49.135235 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-89a5c6f3-b874-417b-8790-8ffb542b95a3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:49.137255 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-89a5c6f3-b874-417b-8790-8ffb542b95a3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:49.144957 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-89a5c6f3-b874-417b-8790-8ffb542b95a3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:49.145447 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-89a5c6f3-b874-417b-8790-8ffb542b95a3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:49.146244 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-89a5c6f3-b874-417b-8790-8ffb542b95a3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:49.146666 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-89a5c6f3-b874-417b-8790-8ffb542b95a3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:49.211035 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-89a5c6f3-b874-417b-8790-8ffb542b95a3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.079927 Nov 24 16:12:49.211919 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 476/931] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:49 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:49.799772 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7a970e0c-eb23-4f8f-8a2e-ce9f07b9d0d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:49.800911 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7a970e0c-eb23-4f8f-8a2e-ce9f07b9d0d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:49.808930 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a970e0c-eb23-4f8f-8a2e-ce9f07b9d0d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:49.809424 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a970e0c-eb23-4f8f-8a2e-ce9f07b9d0d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:49.810249 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a970e0c-eb23-4f8f-8a2e-ce9f07b9d0d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:49.810690 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a970e0c-eb23-4f8f-8a2e-ce9f07b9d0d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:49.873610 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7a970e0c-eb23-4f8f-8a2e-ce9f07b9d0d6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 14 microversion: 2.1 time: 0.078006 Nov 24 16:12:49.874356 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 456/932] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:49 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:12:50.224230 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5bd09326-cda0-4bd1-a26a-41be5d1fbc01 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:50.225253 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5bd09326-cda0-4bd1-a26a-41be5d1fbc01 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:50.232152 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5bd09326-cda0-4bd1-a26a-41be5d1fbc01 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:50.232620 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5bd09326-cda0-4bd1-a26a-41be5d1fbc01 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:50.233473 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5bd09326-cda0-4bd1-a26a-41be5d1fbc01 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:50.233912 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5bd09326-cda0-4bd1-a26a-41be5d1fbc01 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:50.307434 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5bd09326-cda0-4bd1-a26a-41be5d1fbc01 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.087594 Nov 24 16:12:50.308147 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 477/933] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:50 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:50.886704 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-44cd9a3c-d37e-4a04-b3a6-89612ffff2e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:50.887886 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-44cd9a3c-d37e-4a04-b3a6-89612ffff2e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:50.896673 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44cd9a3c-d37e-4a04-b3a6-89612ffff2e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:50.897492 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44cd9a3c-d37e-4a04-b3a6-89612ffff2e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:50.898367 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44cd9a3c-d37e-4a04-b3a6-89612ffff2e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:50.898822 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-44cd9a3c-d37e-4a04-b3a6-89612ffff2e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:50.986719 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-44cd9a3c-d37e-4a04-b3a6-89612ffff2e7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 14 microversion: 2.1 time: 0.105278 Nov 24 16:12:50.991373 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 457/934] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:50 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:12:51.320049 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9d8eb11d-e64e-4683-a167-9d63f474e97d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:51.321657 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9d8eb11d-e64e-4683-a167-9d63f474e97d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:51.329952 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9d8eb11d-e64e-4683-a167-9d63f474e97d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:51.330516 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9d8eb11d-e64e-4683-a167-9d63f474e97d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:51.331374 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9d8eb11d-e64e-4683-a167-9d63f474e97d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:51.331888 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9d8eb11d-e64e-4683-a167-9d63f474e97d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:51.406425 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9d8eb11d-e64e-4683-a167-9d63f474e97d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.090480 Nov 24 16:12:51.407493 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 478/935] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:51 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:52.001895 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cbce6ca7-e30a-44a2-aa9e-621f24677a44 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:52.002961 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cbce6ca7-e30a-44a2-aa9e-621f24677a44 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:52.010308 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cbce6ca7-e30a-44a2-aa9e-621f24677a44 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:52.011082 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cbce6ca7-e30a-44a2-aa9e-621f24677a44 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:52.012130 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cbce6ca7-e30a-44a2-aa9e-621f24677a44 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:52.012760 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cbce6ca7-e30a-44a2-aa9e-621f24677a44 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:52.087113 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cbce6ca7-e30a-44a2-aa9e-621f24677a44 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 13379 microversion: 2.1 time: 0.091089 Nov 24 16:12:52.087796 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 458/936] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:51 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 13379 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:12:52.419856 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e513c63f-81f1-4e8c-a1b4-4d4537de0b05 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:52.420862 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e513c63f-81f1-4e8c-a1b4-4d4537de0b05 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:52.428363 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e513c63f-81f1-4e8c-a1b4-4d4537de0b05 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:52.428811 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e513c63f-81f1-4e8c-a1b4-4d4537de0b05 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:52.429673 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e513c63f-81f1-4e8c-a1b4-4d4537de0b05 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:52.430092 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e513c63f-81f1-4e8c-a1b4-4d4537de0b05 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:52.492986 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e513c63f-81f1-4e8c-a1b4-4d4537de0b05 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.077646 Nov 24 16:12:52.493702 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 479/937] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:52 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:53.098834 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9c739013-0aa6-47e6-a820-44e911424264 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:53.101472 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9c739013-0aa6-47e6-a820-44e911424264 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:53.109727 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9c739013-0aa6-47e6-a820-44e911424264 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:53.110670 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9c739013-0aa6-47e6-a820-44e911424264 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:53.111567 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9c739013-0aa6-47e6-a820-44e911424264 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:53.112077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9c739013-0aa6-47e6-a820-44e911424264 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:53.210434 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9c739013-0aa6-47e6-a820-44e911424264 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 18449 microversion: 2.1 time: 0.115474 Nov 24 16:12:53.215436 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 459/938] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:53 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 18449 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:12:53.509781 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e95fd876-aa91-4609-8869-b90c36760b6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:53.509781 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e95fd876-aa91-4609-8869-b90c36760b6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:53.516096 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e95fd876-aa91-4609-8869-b90c36760b6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:53.516879 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e95fd876-aa91-4609-8869-b90c36760b6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:53.517894 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e95fd876-aa91-4609-8869-b90c36760b6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:53.518340 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e95fd876-aa91-4609-8869-b90c36760b6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:53.597283 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e95fd876-aa91-4609-8869-b90c36760b6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.092072 Nov 24 16:12:53.602252 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 480/939] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:53 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:12:54.225946 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-88065ae0-17f1-4f83-8211-9d894f165e50 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:54.227779 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-88065ae0-17f1-4f83-8211-9d894f165e50 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:54.241404 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88065ae0-17f1-4f83-8211-9d894f165e50 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:54.242234 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88065ae0-17f1-4f83-8211-9d894f165e50 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:54.243723 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88065ae0-17f1-4f83-8211-9d894f165e50 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:54.244530 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88065ae0-17f1-4f83-8211-9d894f165e50 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:54.322319 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-88065ae0-17f1-4f83-8211-9d894f165e50 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 19342 microversion: 2.1 time: 0.103776 Nov 24 16:12:54.324296 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 460/940] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:54 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 19342 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:12:54.611261 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b9f92637-7467-429b-9aba-e8d6b9306101 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:54.612153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b9f92637-7467-429b-9aba-e8d6b9306101 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:54.619321 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b9f92637-7467-429b-9aba-e8d6b9306101 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:54.619760 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b9f92637-7467-429b-9aba-e8d6b9306101 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:54.621325 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b9f92637-7467-429b-9aba-e8d6b9306101 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:54.621789 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b9f92637-7467-429b-9aba-e8d6b9306101 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:54.685760 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b9f92637-7467-429b-9aba-e8d6b9306101 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.078154 Nov 24 16:12:54.691980 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 481/941] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:54 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:55.336160 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-89097d3a-e873-411e-a276-e506cbe25299 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:55.337644 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-89097d3a-e873-411e-a276-e506cbe25299 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:55.346418 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-89097d3a-e873-411e-a276-e506cbe25299 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:55.347314 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-89097d3a-e873-411e-a276-e506cbe25299 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:55.348442 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-89097d3a-e873-411e-a276-e506cbe25299 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:55.348965 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-89097d3a-e873-411e-a276-e506cbe25299 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:55.454661 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-89097d3a-e873-411e-a276-e506cbe25299 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 22021 microversion: 2.1 time: 0.122782 Nov 24 16:12:55.456086 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 461/942] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:55 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 22021 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:12:55.703456 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-13dfe888-f108-4f9e-93f7-db579a64d301 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:55.705837 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-13dfe888-f108-4f9e-93f7-db579a64d301 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:55.717562 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-13dfe888-f108-4f9e-93f7-db579a64d301 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:55.718781 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-13dfe888-f108-4f9e-93f7-db579a64d301 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:55.720157 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-13dfe888-f108-4f9e-93f7-db579a64d301 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:55.721097 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-13dfe888-f108-4f9e-93f7-db579a64d301 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:55.812132 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-13dfe888-f108-4f9e-93f7-db579a64d301 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.116763 Nov 24 16:12:55.813577 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 482/943] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:55 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:56.470317 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-96960125-7ac2-4b8d-b01e-2783cd6412fa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:56.472555 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-96960125-7ac2-4b8d-b01e-2783cd6412fa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:56.486018 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96960125-7ac2-4b8d-b01e-2783cd6412fa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:56.486862 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96960125-7ac2-4b8d-b01e-2783cd6412fa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:56.487776 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96960125-7ac2-4b8d-b01e-2783cd6412fa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:56.488303 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96960125-7ac2-4b8d-b01e-2783cd6412fa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:56.572395 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-96960125-7ac2-4b8d-b01e-2783cd6412fa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 23563 microversion: 2.1 time: 0.106167 Nov 24 16:12:56.576032 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 462/944] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:56 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 23563 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:12:56.829163 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3e5e7519-bb4b-45fe-9c47-163335754567 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:56.831087 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3e5e7519-bb4b-45fe-9c47-163335754567 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:56.839745 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e5e7519-bb4b-45fe-9c47-163335754567 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:56.840808 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e5e7519-bb4b-45fe-9c47-163335754567 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:56.841911 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e5e7519-bb4b-45fe-9c47-163335754567 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:56.842583 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e5e7519-bb4b-45fe-9c47-163335754567 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:56.916078 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3e5e7519-bb4b-45fe-9c47-163335754567 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.092700 Nov 24 16:12:56.919839 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 483/945] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:56 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:12:57.589369 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9a71b908-2a58-43aa-a5fb-b602b0a01f34 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:57.591642 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9a71b908-2a58-43aa-a5fb-b602b0a01f34 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:57.604119 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9a71b908-2a58-43aa-a5fb-b602b0a01f34 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:57.604953 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9a71b908-2a58-43aa-a5fb-b602b0a01f34 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:57.606442 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9a71b908-2a58-43aa-a5fb-b602b0a01f34 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:57.607240 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9a71b908-2a58-43aa-a5fb-b602b0a01f34 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:57.707487 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9a71b908-2a58-43aa-a5fb-b602b0a01f34 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 25248 microversion: 2.1 time: 0.125668 Nov 24 16:12:57.708174 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 463/946] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:57 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 25248 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:12:57.933277 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e305ff37-603c-487c-a7a2-86406a457c98 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:57.934364 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e305ff37-603c-487c-a7a2-86406a457c98 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:57.941898 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e305ff37-603c-487c-a7a2-86406a457c98 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:57.942376 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e305ff37-603c-487c-a7a2-86406a457c98 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:57.943775 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e305ff37-603c-487c-a7a2-86406a457c98 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:57.944229 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e305ff37-603c-487c-a7a2-86406a457c98 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:58.028133 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e305ff37-603c-487c-a7a2-86406a457c98 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.099669 Nov 24 16:12:58.037183 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 484/947] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:57 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:58.721713 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b1131e72-64f5-4f71-9ca1-9c4995c9db88 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:58.722618 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b1131e72-64f5-4f71-9ca1-9c4995c9db88 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:58.730702 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1131e72-64f5-4f71-9ca1-9c4995c9db88 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:58.731233 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1131e72-64f5-4f71-9ca1-9c4995c9db88 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:58.732161 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1131e72-64f5-4f71-9ca1-9c4995c9db88 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:58.732631 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b1131e72-64f5-4f71-9ca1-9c4995c9db88 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:58.918666 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b1131e72-64f5-4f71-9ca1-9c4995c9db88 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 26781 microversion: 2.1 time: 0.201039 Nov 24 16:12:58.919456 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 464/948] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:58 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 26781 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:12:59.045682 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-162edf1e-cc78-4366-aa3a-a6c219ccf63a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:59.046609 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-162edf1e-cc78-4366-aa3a-a6c219ccf63a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:59.054031 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-162edf1e-cc78-4366-aa3a-a6c219ccf63a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:59.054476 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-162edf1e-cc78-4366-aa3a-a6c219ccf63a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:59.055267 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-162edf1e-cc78-4366-aa3a-a6c219ccf63a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:59.055697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-162edf1e-cc78-4366-aa3a-a6c219ccf63a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:59.118712 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-162edf1e-cc78-4366-aa3a-a6c219ccf63a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.077813 Nov 24 16:12:59.119373 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 485/949] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:12:59 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:12:59.931492 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1035df7e-5ae9-439b-ad22-6934e0426a3e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:12:59.933161 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1035df7e-5ae9-439b-ad22-6934e0426a3e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:12:59.940828 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1035df7e-5ae9-439b-ad22-6934e0426a3e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:59.941311 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1035df7e-5ae9-439b-ad22-6934e0426a3e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:12:59.942154 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1035df7e-5ae9-439b-ad22-6934e0426a3e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:12:59.942595 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1035df7e-5ae9-439b-ad22-6934e0426a3e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:00.024416 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1035df7e-5ae9-439b-ad22-6934e0426a3e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 27608 microversion: 2.1 time: 0.097016 Nov 24 16:13:00.025138 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 465/950] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:12:59 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 27608 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:00.136989 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8c0ad907-4644-482b-89ab-487065443374 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:00.138716 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8c0ad907-4644-482b-89ab-487065443374 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:00.149129 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c0ad907-4644-482b-89ab-487065443374 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:00.149505 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c0ad907-4644-482b-89ab-487065443374 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:00.150322 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c0ad907-4644-482b-89ab-487065443374 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:00.150786 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8c0ad907-4644-482b-89ab-487065443374 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:00.215227 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8c0ad907-4644-482b-89ab-487065443374 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.085550 Nov 24 16:13:00.215903 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 486/951] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:00 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:01.039035 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1fff286e-ded1-4b4e-bf6d-f4e868c6980d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:01.041173 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1fff286e-ded1-4b4e-bf6d-f4e868c6980d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:01.048860 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1fff286e-ded1-4b4e-bf6d-f4e868c6980d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:01.049349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1fff286e-ded1-4b4e-bf6d-f4e868c6980d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:01.050204 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1fff286e-ded1-4b4e-bf6d-f4e868c6980d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:01.050649 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1fff286e-ded1-4b4e-bf6d-f4e868c6980d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:01.131060 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1fff286e-ded1-4b4e-bf6d-f4e868c6980d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 27919 microversion: 2.1 time: 0.096001 Nov 24 16:13:01.131729 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 466/952] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:01 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 27919 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:01.228208 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9def8e22-b88c-412e-8a51-230dee2d2fe2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:01.229930 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9def8e22-b88c-412e-8a51-230dee2d2fe2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:01.237358 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9def8e22-b88c-412e-8a51-230dee2d2fe2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:01.245755 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9def8e22-b88c-412e-8a51-230dee2d2fe2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:01.246779 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9def8e22-b88c-412e-8a51-230dee2d2fe2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:01.247223 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9def8e22-b88c-412e-8a51-230dee2d2fe2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:01.319716 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9def8e22-b88c-412e-8a51-230dee2d2fe2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.095338 Nov 24 16:13:01.320287 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 487/953] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:01 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:02.143411 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c0fed760-7251-49c2-8050-865ce59deec6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:02.144410 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c0fed760-7251-49c2-8050-865ce59deec6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:02.152202 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c0fed760-7251-49c2-8050-865ce59deec6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:02.152773 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c0fed760-7251-49c2-8050-865ce59deec6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:02.153634 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c0fed760-7251-49c2-8050-865ce59deec6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:02.154064 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c0fed760-7251-49c2-8050-865ce59deec6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:02.231082 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c0fed760-7251-49c2-8050-865ce59deec6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28154 microversion: 2.1 time: 0.091531 Nov 24 16:13:02.231750 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 467/954] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:02 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28154 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:02.333258 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1d7b77ab-3ac4-4f55-825d-f868e40debbd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:02.334245 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1d7b77ab-3ac4-4f55-825d-f868e40debbd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:02.342352 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1d7b77ab-3ac4-4f55-825d-f868e40debbd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:02.342802 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1d7b77ab-3ac4-4f55-825d-f868e40debbd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:02.343601 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1d7b77ab-3ac4-4f55-825d-f868e40debbd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:02.344027 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1d7b77ab-3ac4-4f55-825d-f868e40debbd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:02.411681 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1d7b77ab-3ac4-4f55-825d-f868e40debbd tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.082588 Nov 24 16:13:02.412536 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 488/955] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:02 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:03.246792 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f387ac07-f2d6-4ddf-b966-812d05a5c95d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:03.248306 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f387ac07-f2d6-4ddf-b966-812d05a5c95d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:03.255111 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f387ac07-f2d6-4ddf-b966-812d05a5c95d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:03.255553 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f387ac07-f2d6-4ddf-b966-812d05a5c95d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:03.256321 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f387ac07-f2d6-4ddf-b966-812d05a5c95d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:03.256751 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f387ac07-f2d6-4ddf-b966-812d05a5c95d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:03.324453 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f387ac07-f2d6-4ddf-b966-812d05a5c95d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28154 microversion: 2.1 time: 0.082083 Nov 24 16:13:03.325100 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 468/956] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:03 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28154 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:03.423970 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2972cb48-8fcc-4035-9b7f-fc55dba36a8c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:03.424963 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2972cb48-8fcc-4035-9b7f-fc55dba36a8c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:03.433448 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2972cb48-8fcc-4035-9b7f-fc55dba36a8c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:03.433901 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2972cb48-8fcc-4035-9b7f-fc55dba36a8c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:03.434680 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2972cb48-8fcc-4035-9b7f-fc55dba36a8c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:03.435113 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2972cb48-8fcc-4035-9b7f-fc55dba36a8c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:03.502170 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2972cb48-8fcc-4035-9b7f-fc55dba36a8c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.082130 Nov 24 16:13:03.502821 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 489/957] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:03 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:04.336955 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7a9d2822-c930-455e-b0d7-f5ff6125cf83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:04.337979 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7a9d2822-c930-455e-b0d7-f5ff6125cf83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:04.345729 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a9d2822-c930-455e-b0d7-f5ff6125cf83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:04.346183 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a9d2822-c930-455e-b0d7-f5ff6125cf83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:04.346972 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a9d2822-c930-455e-b0d7-f5ff6125cf83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:04.347409 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a9d2822-c930-455e-b0d7-f5ff6125cf83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:04.413183 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7a9d2822-c930-455e-b0d7-f5ff6125cf83 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28154 microversion: 2.1 time: 0.080080 Nov 24 16:13:04.414109 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 469/958] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:04 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28154 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:04.515113 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e58939aa-79c2-4f8c-8ea8-1d5645de841d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:04.516023 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e58939aa-79c2-4f8c-8ea8-1d5645de841d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:04.523009 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e58939aa-79c2-4f8c-8ea8-1d5645de841d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:04.523469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e58939aa-79c2-4f8c-8ea8-1d5645de841d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:04.524286 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e58939aa-79c2-4f8c-8ea8-1d5645de841d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:04.524717 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e58939aa-79c2-4f8c-8ea8-1d5645de841d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:04.593244 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e58939aa-79c2-4f8c-8ea8-1d5645de841d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.082748 Nov 24 16:13:04.593930 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 490/959] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:04 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:05.425431 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-49d6abee-71c2-4ede-95b9-24562ce77c32 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:05.426248 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-49d6abee-71c2-4ede-95b9-24562ce77c32 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:05.433643 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49d6abee-71c2-4ede-95b9-24562ce77c32 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:05.434087 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49d6abee-71c2-4ede-95b9-24562ce77c32 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:05.434868 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49d6abee-71c2-4ede-95b9-24562ce77c32 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:05.435296 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49d6abee-71c2-4ede-95b9-24562ce77c32 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:05.498066 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-49d6abee-71c2-4ede-95b9-24562ce77c32 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28154 microversion: 2.1 time: 0.076407 Nov 24 16:13:05.498701 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 470/960] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:05 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28154 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:05.605665 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6f10689a-7897-4c6c-8647-7dc25ca93463 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:05.606695 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6f10689a-7897-4c6c-8647-7dc25ca93463 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:05.613615 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6f10689a-7897-4c6c-8647-7dc25ca93463 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:05.614063 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6f10689a-7897-4c6c-8647-7dc25ca93463 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:05.614845 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6f10689a-7897-4c6c-8647-7dc25ca93463 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:05.615277 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6f10689a-7897-4c6c-8647-7dc25ca93463 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:05.684199 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6f10689a-7897-4c6c-8647-7dc25ca93463 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.083020 Nov 24 16:13:05.684756 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 491/961] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:05 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:13:06.510910 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e94dcbc5-0e8d-45e2-9c2c-b70e708cdbe8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:06.511990 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e94dcbc5-0e8d-45e2-9c2c-b70e708cdbe8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:06.518879 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e94dcbc5-0e8d-45e2-9c2c-b70e708cdbe8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:06.519333 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e94dcbc5-0e8d-45e2-9c2c-b70e708cdbe8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:06.520120 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e94dcbc5-0e8d-45e2-9c2c-b70e708cdbe8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:06.520558 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e94dcbc5-0e8d-45e2-9c2c-b70e708cdbe8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:06.590411 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e94dcbc5-0e8d-45e2-9c2c-b70e708cdbe8 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28154 microversion: 2.1 time: 0.084026 Nov 24 16:13:06.591409 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 471/962] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:06 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28154 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:06.696191 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-74e26199-afdc-402b-b700-a958400daa59 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:06.697181 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-74e26199-afdc-402b-b700-a958400daa59 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:06.704750 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-74e26199-afdc-402b-b700-a958400daa59 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:06.705230 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-74e26199-afdc-402b-b700-a958400daa59 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:06.706008 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-74e26199-afdc-402b-b700-a958400daa59 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:06.706434 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-74e26199-afdc-402b-b700-a958400daa59 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:06.765411 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-74e26199-afdc-402b-b700-a958400daa59 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.072916 Nov 24 16:13:06.765991 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 492/963] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:06 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:07.602433 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c1766b27-8599-4ced-9737-eb2db71d37da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:07.603436 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c1766b27-8599-4ced-9737-eb2db71d37da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:07.611225 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1766b27-8599-4ced-9737-eb2db71d37da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:07.611679 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1766b27-8599-4ced-9737-eb2db71d37da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:07.612473 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1766b27-8599-4ced-9737-eb2db71d37da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:07.612908 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c1766b27-8599-4ced-9737-eb2db71d37da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:07.672894 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c1766b27-8599-4ced-9737-eb2db71d37da tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28154 microversion: 2.1 time: 0.074394 Nov 24 16:13:07.673604 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 472/964] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:07 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28154 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:07.778481 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ab838c30-d0f3-4077-8ab6-1131b394a92a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:07.779472 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ab838c30-d0f3-4077-8ab6-1131b394a92a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:07.786406 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ab838c30-d0f3-4077-8ab6-1131b394a92a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:07.786857 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ab838c30-d0f3-4077-8ab6-1131b394a92a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:07.787639 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ab838c30-d0f3-4077-8ab6-1131b394a92a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:07.788072 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ab838c30-d0f3-4077-8ab6-1131b394a92a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:07.855517 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ab838c30-d0f3-4077-8ab6-1131b394a92a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.081531 Nov 24 16:13:07.856081 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 493/965] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:07 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:08.686215 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7b64dc19-42cd-473c-88bd-2525053c2bfa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:08.687234 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7b64dc19-42cd-473c-88bd-2525053c2bfa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:08.694314 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7b64dc19-42cd-473c-88bd-2525053c2bfa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:08.694767 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7b64dc19-42cd-473c-88bd-2525053c2bfa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:08.695565 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7b64dc19-42cd-473c-88bd-2525053c2bfa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:08.696009 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7b64dc19-42cd-473c-88bd-2525053c2bfa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:08.771008 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7b64dc19-42cd-473c-88bd-2525053c2bfa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28154 microversion: 2.1 time: 0.089372 Nov 24 16:13:08.771927 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 473/966] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:08 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28154 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:08.870566 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c0405e17-afa8-4d27-8732-5d411af3ad72 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:08.871567 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c0405e17-afa8-4d27-8732-5d411af3ad72 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:08.878751 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c0405e17-afa8-4d27-8732-5d411af3ad72 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:08.879190 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c0405e17-afa8-4d27-8732-5d411af3ad72 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:08.879964 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c0405e17-afa8-4d27-8732-5d411af3ad72 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:08.880386 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c0405e17-afa8-4d27-8732-5d411af3ad72 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:08.947393 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c0405e17-afa8-4d27-8732-5d411af3ad72 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.081711 Nov 24 16:13:08.947992 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 494/967] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:08 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:13:09.783474 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0b684214-741b-446d-8a6c-e64b3cc4e33d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:09.784475 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0b684214-741b-446d-8a6c-e64b3cc4e33d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:09.791977 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b684214-741b-446d-8a6c-e64b3cc4e33d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:09.792430 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b684214-741b-446d-8a6c-e64b3cc4e33d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:09.793267 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b684214-741b-446d-8a6c-e64b3cc4e33d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:09.793707 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0b684214-741b-446d-8a6c-e64b3cc4e33d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:09.858518 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0b684214-741b-446d-8a6c-e64b3cc4e33d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28154 microversion: 2.1 time: 0.078977 Nov 24 16:13:09.859314 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 474/968] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:09 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28154 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:09.959861 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-34bbd1d9-bbe5-4bfc-90d4-ffc0465794d3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:09.960890 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-34bbd1d9-bbe5-4bfc-90d4-ffc0465794d3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:09.967998 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-34bbd1d9-bbe5-4bfc-90d4-ffc0465794d3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:09.968447 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-34bbd1d9-bbe5-4bfc-90d4-ffc0465794d3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:09.969278 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-34bbd1d9-bbe5-4bfc-90d4-ffc0465794d3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:09.969707 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-34bbd1d9-bbe5-4bfc-90d4-ffc0465794d3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:10.034178 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-34bbd1d9-bbe5-4bfc-90d4-ffc0465794d3 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.078185 Nov 24 16:13:10.034791 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 495/969] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:09 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:10.871390 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-162a8a9b-a544-433f-923a-eb135f12ba4b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:10.872642 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-162a8a9b-a544-433f-923a-eb135f12ba4b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:10.879460 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-162a8a9b-a544-433f-923a-eb135f12ba4b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:10.879902 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-162a8a9b-a544-433f-923a-eb135f12ba4b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:10.880674 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-162a8a9b-a544-433f-923a-eb135f12ba4b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:10.881132 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-162a8a9b-a544-433f-923a-eb135f12ba4b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:10.952522 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-162a8a9b-a544-433f-923a-eb135f12ba4b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28154 microversion: 2.1 time: 0.085272 Nov 24 16:13:10.953176 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 475/970] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:10 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28154 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:11.046472 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-bc2f7f82-cfb1-458b-81e5-58ab1fb2f0c7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:11.047477 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-bc2f7f82-cfb1-458b-81e5-58ab1fb2f0c7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:11.054344 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bc2f7f82-cfb1-458b-81e5-58ab1fb2f0c7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:11.054788 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bc2f7f82-cfb1-458b-81e5-58ab1fb2f0c7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:11.055564 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bc2f7f82-cfb1-458b-81e5-58ab1fb2f0c7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:11.055993 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bc2f7f82-cfb1-458b-81e5-58ab1fb2f0c7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:11.119838 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-bc2f7f82-cfb1-458b-81e5-58ab1fb2f0c7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 28645 microversion: 2.20 time: 0.076591 Nov 24 16:13:11.120832 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 496/971] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:11 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 28645 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:11.965511 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b3406edd-3d6b-40f3-b7c3-5cb3321778ed tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:11.966591 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b3406edd-3d6b-40f3-b7c3-5cb3321778ed tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:11.973581 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b3406edd-3d6b-40f3-b7c3-5cb3321778ed tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:11.974032 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b3406edd-3d6b-40f3-b7c3-5cb3321778ed tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:11.974832 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b3406edd-3d6b-40f3-b7c3-5cb3321778ed tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:11.975275 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b3406edd-3d6b-40f3-b7c3-5cb3321778ed tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:12.044146 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b3406edd-3d6b-40f3-b7c3-5cb3321778ed tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28154 microversion: 2.1 time: 0.082682 Nov 24 16:13:12.045071 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 476/972] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:11 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28154 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:12.132588 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b50aaa81-fb00-42a7-9fec-f625cc25e923 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:12.133602 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b50aaa81-fb00-42a7-9fec-f625cc25e923 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:12.141578 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b50aaa81-fb00-42a7-9fec-f625cc25e923 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:12.142032 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b50aaa81-fb00-42a7-9fec-f625cc25e923 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:12.142811 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b50aaa81-fb00-42a7-9fec-f625cc25e923 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:12.143250 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b50aaa81-fb00-42a7-9fec-f625cc25e923 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:12.217284 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b50aaa81-fb00-42a7-9fec-f625cc25e923 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 30319 microversion: 2.20 time: 0.088858 Nov 24 16:13:12.217879 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 497/973] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:12 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 30319 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:13.056488 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-79fe56a8-4606-4a84-a5c6-73eaf251aada tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:13.057531 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-79fe56a8-4606-4a84-a5c6-73eaf251aada tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:13.064493 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79fe56a8-4606-4a84-a5c6-73eaf251aada tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:13.064945 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79fe56a8-4606-4a84-a5c6-73eaf251aada tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:13.065764 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79fe56a8-4606-4a84-a5c6-73eaf251aada tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:13.066205 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79fe56a8-4606-4a84-a5c6-73eaf251aada tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:13.128874 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-79fe56a8-4606-4a84-a5c6-73eaf251aada tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28154 microversion: 2.1 time: 0.076403 Nov 24 16:13:13.129582 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 477/974] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:13 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28154 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:13.229235 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7cc47073-efc8-4214-9820-98d52d235f39 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:13.230218 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7cc47073-efc8-4214-9820-98d52d235f39 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:13.237117 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7cc47073-efc8-4214-9820-98d52d235f39 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:13.237521 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7cc47073-efc8-4214-9820-98d52d235f39 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:13.238287 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7cc47073-efc8-4214-9820-98d52d235f39 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:13.238715 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7cc47073-efc8-4214-9820-98d52d235f39 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:13.314433 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7cc47073-efc8-4214-9820-98d52d235f39 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 32131 microversion: 2.20 time: 0.089221 Nov 24 16:13:13.315028 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 498/975] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:13 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 32131 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:14.140809 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-da2f9e97-ee9a-4886-bb0d-6720ab775a24 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:14.141831 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-da2f9e97-ee9a-4886-bb0d-6720ab775a24 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:14.148675 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-da2f9e97-ee9a-4886-bb0d-6720ab775a24 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:14.149169 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-da2f9e97-ee9a-4886-bb0d-6720ab775a24 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:14.149977 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-da2f9e97-ee9a-4886-bb0d-6720ab775a24 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:14.151496 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-da2f9e97-ee9a-4886-bb0d-6720ab775a24 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:14.229234 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-da2f9e97-ee9a-4886-bb0d-6720ab775a24 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28445 microversion: 2.1 time: 0.091664 Nov 24 16:13:14.230218 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 478/976] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:14 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:14.326947 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a1c6c495-cda5-4f6c-a579-b1e98edcdc5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:14.328003 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a1c6c495-cda5-4f6c-a579-b1e98edcdc5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:14.335226 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a1c6c495-cda5-4f6c-a579-b1e98edcdc5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:14.335674 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a1c6c495-cda5-4f6c-a579-b1e98edcdc5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:14.336455 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a1c6c495-cda5-4f6c-a579-b1e98edcdc5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:14.336887 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a1c6c495-cda5-4f6c-a579-b1e98edcdc5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:14.408349 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a1c6c495-cda5-4f6c-a579-b1e98edcdc5e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 33211 microversion: 2.20 time: 0.085382 Nov 24 16:13:14.408906 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 499/977] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:14 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 33211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:13:15.241444 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ac9cf468-f955-4810-a857-9486b9fd0703 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:15.242438 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ac9cf468-f955-4810-a857-9486b9fd0703 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:15.250296 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac9cf468-f955-4810-a857-9486b9fd0703 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:15.250743 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac9cf468-f955-4810-a857-9486b9fd0703 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:15.251518 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac9cf468-f955-4810-a857-9486b9fd0703 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:15.251948 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac9cf468-f955-4810-a857-9486b9fd0703 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:15.312066 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ac9cf468-f955-4810-a857-9486b9fd0703 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28445 microversion: 2.1 time: 0.074459 Nov 24 16:13:15.312626 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 479/978] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:15 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28445 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:15.420817 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-da8071d1-e6e1-4dd1-b239-dc473d659bfb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:15.421844 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-da8071d1-e6e1-4dd1-b239-dc473d659bfb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:15.428736 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-da8071d1-e6e1-4dd1-b239-dc473d659bfb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:15.429209 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-da8071d1-e6e1-4dd1-b239-dc473d659bfb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:15.429991 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-da8071d1-e6e1-4dd1-b239-dc473d659bfb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:15.430418 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-da8071d1-e6e1-4dd1-b239-dc473d659bfb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:15.513697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-da8071d1-e6e1-4dd1-b239-dc473d659bfb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 34477 microversion: 2.20 time: 0.097306 Nov 24 16:13:15.514662 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 500/979] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:15 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 34477 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:16.325183 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d30141a0-7297-4866-be88-eeccc29941d3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:16.326817 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d30141a0-7297-4866-be88-eeccc29941d3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:16.334452 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d30141a0-7297-4866-be88-eeccc29941d3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:16.334892 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d30141a0-7297-4866-be88-eeccc29941d3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:16.335706 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d30141a0-7297-4866-be88-eeccc29941d3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:16.336136 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d30141a0-7297-4866-be88-eeccc29941d3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:16.418067 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d30141a0-7297-4866-be88-eeccc29941d3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.097426 Nov 24 16:13:16.418774 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 480/980] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:16 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:16.526341 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c5f6bd61-f1e1-4023-8ba4-c8f3279d79b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:16.527249 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c5f6bd61-f1e1-4023-8ba4-c8f3279d79b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:16.534346 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c5f6bd61-f1e1-4023-8ba4-c8f3279d79b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:16.534786 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c5f6bd61-f1e1-4023-8ba4-c8f3279d79b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:16.535560 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c5f6bd61-f1e1-4023-8ba4-c8f3279d79b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:16.535993 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c5f6bd61-f1e1-4023-8ba4-c8f3279d79b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:16.617981 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c5f6bd61-f1e1-4023-8ba4-c8f3279d79b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 35903 microversion: 2.20 time: 0.095751 Nov 24 16:13:16.619394 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 501/981] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:16 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 35903 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:17.430549 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a7cbd7bd-c224-474f-b2db-002faaa53fa4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:17.432376 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a7cbd7bd-c224-474f-b2db-002faaa53fa4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:17.439856 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a7cbd7bd-c224-474f-b2db-002faaa53fa4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:17.440312 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a7cbd7bd-c224-474f-b2db-002faaa53fa4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:17.441134 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a7cbd7bd-c224-474f-b2db-002faaa53fa4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:17.441574 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a7cbd7bd-c224-474f-b2db-002faaa53fa4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:17.512240 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a7cbd7bd-c224-474f-b2db-002faaa53fa4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.085676 Nov 24 16:13:17.513040 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 481/982] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:17 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:17.631152 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c8b76650-200b-40d0-8048-50a05c4b922a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:17.632152 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c8b76650-200b-40d0-8048-50a05c4b922a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:17.639200 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c8b76650-200b-40d0-8048-50a05c4b922a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:17.639648 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c8b76650-200b-40d0-8048-50a05c4b922a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:17.640436 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c8b76650-200b-40d0-8048-50a05c4b922a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:17.640866 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c8b76650-200b-40d0-8048-50a05c4b922a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:17.724663 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c8b76650-200b-40d0-8048-50a05c4b922a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 37725 microversion: 2.20 time: 0.097356 Nov 24 16:13:17.725619 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 502/983] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:17 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 37725 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:13:18.524247 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-763f5ac1-ccad-442f-9e44-a85f54544d71 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:18.526022 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-763f5ac1-ccad-442f-9e44-a85f54544d71 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:18.533014 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-763f5ac1-ccad-442f-9e44-a85f54544d71 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:18.533523 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-763f5ac1-ccad-442f-9e44-a85f54544d71 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:18.534316 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-763f5ac1-ccad-442f-9e44-a85f54544d71 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:18.534756 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-763f5ac1-ccad-442f-9e44-a85f54544d71 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:18.598490 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-763f5ac1-ccad-442f-9e44-a85f54544d71 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.078102 Nov 24 16:13:18.599792 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 482/984] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:18 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:18.737635 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4a6b9340-7e2e-4a89-85ea-d71edc13cfd6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:18.738628 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4a6b9340-7e2e-4a89-85ea-d71edc13cfd6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:18.746612 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4a6b9340-7e2e-4a89-85ea-d71edc13cfd6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:18.747060 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4a6b9340-7e2e-4a89-85ea-d71edc13cfd6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:18.748094 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4a6b9340-7e2e-4a89-85ea-d71edc13cfd6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:18.748523 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4a6b9340-7e2e-4a89-85ea-d71edc13cfd6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:18.822989 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4a6b9340-7e2e-4a89-85ea-d71edc13cfd6 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 38204 microversion: 2.20 time: 0.088543 Nov 24 16:13:18.823645 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 503/985] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:18 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 38204 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:19.610818 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-91732568-aa10-446a-a273-033452a95119 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:19.611815 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-91732568-aa10-446a-a273-033452a95119 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:19.618660 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91732568-aa10-446a-a273-033452a95119 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:19.619623 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91732568-aa10-446a-a273-033452a95119 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:19.620401 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91732568-aa10-446a-a273-033452a95119 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:19.620835 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-91732568-aa10-446a-a273-033452a95119 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:19.690640 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-91732568-aa10-446a-a273-033452a95119 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.083825 Nov 24 16:13:19.691535 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 483/986] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:19 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:19.835842 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-346d17c9-cf8a-41b4-823b-30c4af562dcb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:19.836828 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-346d17c9-cf8a-41b4-823b-30c4af562dcb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:19.844148 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-346d17c9-cf8a-41b4-823b-30c4af562dcb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:19.844599 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-346d17c9-cf8a-41b4-823b-30c4af562dcb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:19.845401 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-346d17c9-cf8a-41b4-823b-30c4af562dcb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:19.845836 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-346d17c9-cf8a-41b4-823b-30c4af562dcb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:19.908407 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-346d17c9-cf8a-41b4-823b-30c4af562dcb tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 38204 microversion: 2.20 time: 0.076494 Nov 24 16:13:19.908952 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 504/987] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:19 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 38204 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:20.703633 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2e37d2b7-9938-4a11-9d9c-01c7d28e8c6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:20.704652 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2e37d2b7-9938-4a11-9d9c-01c7d28e8c6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:20.711559 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e37d2b7-9938-4a11-9d9c-01c7d28e8c6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:20.712009 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e37d2b7-9938-4a11-9d9c-01c7d28e8c6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:20.713458 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e37d2b7-9938-4a11-9d9c-01c7d28e8c6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:20.713900 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e37d2b7-9938-4a11-9d9c-01c7d28e8c6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:20.774657 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2e37d2b7-9938-4a11-9d9c-01c7d28e8c6e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.075127 Nov 24 16:13:20.776074 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 484/988] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:20 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:20.920397 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ee5d49cb-3ce0-44a9-a9cf-1b3dcc0bf9f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:20.921414 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ee5d49cb-3ce0-44a9-a9cf-1b3dcc0bf9f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:20.928275 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ee5d49cb-3ce0-44a9-a9cf-1b3dcc0bf9f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:20.928724 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ee5d49cb-3ce0-44a9-a9cf-1b3dcc0bf9f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:20.929528 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ee5d49cb-3ce0-44a9-a9cf-1b3dcc0bf9f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:20.929963 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ee5d49cb-3ce0-44a9-a9cf-1b3dcc0bf9f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:20.991652 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ee5d49cb-3ce0-44a9-a9cf-1b3dcc0bf9f4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 38204 microversion: 2.20 time: 0.075159 Nov 24 16:13:20.992315 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 505/989] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:20 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 38204 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:13:21.787520 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cd8df631-47cb-4744-a1df-1e175de96c98 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:21.788512 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cd8df631-47cb-4744-a1df-1e175de96c98 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:21.796110 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd8df631-47cb-4744-a1df-1e175de96c98 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:21.796560 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd8df631-47cb-4744-a1df-1e175de96c98 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:21.797386 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd8df631-47cb-4744-a1df-1e175de96c98 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:21.797822 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd8df631-47cb-4744-a1df-1e175de96c98 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:21.857516 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cd8df631-47cb-4744-a1df-1e175de96c98 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.073831 Nov 24 16:13:21.858441 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 485/990] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:21 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:22.004604 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7584b9fd-90f8-40c1-ac09-9ee032d7be08 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:22.005628 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7584b9fd-90f8-40c1-ac09-9ee032d7be08 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:22.012744 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7584b9fd-90f8-40c1-ac09-9ee032d7be08 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:22.013257 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7584b9fd-90f8-40c1-ac09-9ee032d7be08 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:22.014032 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7584b9fd-90f8-40c1-ac09-9ee032d7be08 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:22.014462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7584b9fd-90f8-40c1-ac09-9ee032d7be08 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:22.073758 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7584b9fd-90f8-40c1-ac09-9ee032d7be08 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 38204 microversion: 2.20 time: 0.072951 Nov 24 16:13:22.074607 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 506/991] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:21 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 38204 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:13:22.871124 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-45a07e1f-63fc-490e-bd39-e3b8bfb21d95 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:22.872413 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-45a07e1f-63fc-490e-bd39-e3b8bfb21d95 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:22.880478 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-45a07e1f-63fc-490e-bd39-e3b8bfb21d95 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:22.880927 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-45a07e1f-63fc-490e-bd39-e3b8bfb21d95 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:22.881738 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-45a07e1f-63fc-490e-bd39-e3b8bfb21d95 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:22.882167 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-45a07e1f-63fc-490e-bd39-e3b8bfb21d95 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:22.945286 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-45a07e1f-63fc-490e-bd39-e3b8bfb21d95 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.079399 Nov 24 16:13:22.945973 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 486/992] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:22 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:23.086159 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-bb4bc418-68bb-4387-a209-5a0d60aa3162 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:23.087168 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-bb4bc418-68bb-4387-a209-5a0d60aa3162 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:23.095022 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bb4bc418-68bb-4387-a209-5a0d60aa3162 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:23.095463 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bb4bc418-68bb-4387-a209-5a0d60aa3162 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:23.096240 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bb4bc418-68bb-4387-a209-5a0d60aa3162 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:23.096659 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bb4bc418-68bb-4387-a209-5a0d60aa3162 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:23.165834 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-bb4bc418-68bb-4387-a209-5a0d60aa3162 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 200 len: 38347 microversion: 2.20 time: 0.083637 Nov 24 16:13:23.166451 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 507/993] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:23 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 38347 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:13:23.176774 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a00fd4ef-385c-49ca-b1e7-c73bf4158d69 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:23.177384 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a00fd4ef-385c-49ca-b1e7-c73bf4158d69 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:23.184897 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a00fd4ef-385c-49ca-b1e7-c73bf4158d69 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:23.185413 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a00fd4ef-385c-49ca-b1e7-c73bf4158d69 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:23.186211 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a00fd4ef-385c-49ca-b1e7-c73bf4158d69 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:23.186646 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a00fd4ef-385c-49ca-b1e7-c73bf4158d69 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:23.214119 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a00fd4ef-385c-49ca-b1e7-c73bf4158d69 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/ips" status: 200 len: 151 microversion: 2.20 time: 0.040526 Nov 24 16:13:23.214236 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 487/994] 10.222.0.72 () {60 vars in 1288 bytes} [Wed Nov 24 16:13:23 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:23.958341 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a7e2fc3a-aadb-4b72-b6f8-098f48ad45ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:23.959338 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a7e2fc3a-aadb-4b72-b6f8-098f48ad45ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:23.966867 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a7e2fc3a-aadb-4b72-b6f8-098f48ad45ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:23.967314 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a7e2fc3a-aadb-4b72-b6f8-098f48ad45ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:23.968105 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a7e2fc3a-aadb-4b72-b6f8-098f48ad45ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:23.968545 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a7e2fc3a-aadb-4b72-b6f8-098f48ad45ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:24.032928 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a7e2fc3a-aadb-4b72-b6f8-098f48ad45ec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.078644 Nov 24 16:13:24.033855 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 508/995] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:23 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:25.044592 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ddb68b3b-db9b-4c92-b63e-237bdf2db8d5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:25.045527 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ddb68b3b-db9b-4c92-b63e-237bdf2db8d5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:25.051829 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ddb68b3b-db9b-4c92-b63e-237bdf2db8d5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:25.052277 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ddb68b3b-db9b-4c92-b63e-237bdf2db8d5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:25.053080 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ddb68b3b-db9b-4c92-b63e-237bdf2db8d5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:25.053520 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ddb68b3b-db9b-4c92-b63e-237bdf2db8d5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:25.114579 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ddb68b3b-db9b-4c92-b63e-237bdf2db8d5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.074032 Nov 24 16:13:25.115466 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 488/996] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:25 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:25.306314 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5f15c598-2efd-4392-a0ea-d94dcfb48989 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:25.306904 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5f15c598-2efd-4392-a0ea-d94dcfb48989 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:25.313701 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f15c598-2efd-4392-a0ea-d94dcfb48989 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:25.314140 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f15c598-2efd-4392-a0ea-d94dcfb48989 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:25.314908 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f15c598-2efd-4392-a0ea-d94dcfb48989 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:25.315337 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f15c598-2efd-4392-a0ea-d94dcfb48989 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:25.490011 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.objects.instance [None req-5f15c598-2efd-4392-a0ea-d94dcfb48989 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lazy-loading 'flavor' on Instance uuid b62212ea-7c11-4095-adf5-a78b04d67de0 {{(pid=116303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:13:25.744148 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5f15c598-2efd-4392-a0ea-d94dcfb48989 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 202 len: 0 microversion: 2.20 time: 0.441871 Nov 24 16:13:25.745362 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 509/997] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:25 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 24 16:13:25.754389 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d59a2036-f937-4801-84f9-e478d338a148 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:25.755177 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d59a2036-f937-4801-84f9-e478d338a148 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:25.763160 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d59a2036-f937-4801-84f9-e478d338a148 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:25.763638 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d59a2036-f937-4801-84f9-e478d338a148 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:25.765325 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d59a2036-f937-4801-84f9-e478d338a148 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:25.766200 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d59a2036-f937-4801-84f9-e478d338a148 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:25.900717 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d59a2036-f937-4801-84f9-e478d338a148 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:25.909411 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d59a2036-f937-4801-84f9-e478d338a148 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:25.910913 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d59a2036-f937-4801-84f9-e478d338a148 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:25.912068 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d59a2036-f937-4801-84f9-e478d338a148 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.161869 Nov 24 16:13:25.912620 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 489/998] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:25 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:26.127177 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3e1a531b-aa7d-4ad4-8014-69493853c532 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:26.128070 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3e1a531b-aa7d-4ad4-8014-69493853c532 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:26.135266 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e1a531b-aa7d-4ad4-8014-69493853c532 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:26.135656 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e1a531b-aa7d-4ad4-8014-69493853c532 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:26.136444 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e1a531b-aa7d-4ad4-8014-69493853c532 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:26.136881 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e1a531b-aa7d-4ad4-8014-69493853c532 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:26.195646 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3e1a531b-aa7d-4ad4-8014-69493853c532 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.073109 Nov 24 16:13:26.196283 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 510/999] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:26 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:26.931353 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8bf69759-960c-4bab-a607-13e5345233cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:26.931957 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8bf69759-960c-4bab-a607-13e5345233cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:26.939076 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8bf69759-960c-4bab-a607-13e5345233cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:26.939523 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8bf69759-960c-4bab-a607-13e5345233cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:26.940305 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8bf69759-960c-4bab-a607-13e5345233cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:26.940738 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8bf69759-960c-4bab-a607-13e5345233cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:27.074024 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8bf69759-960c-4bab-a607-13e5345233cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:27.082582 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8bf69759-960c-4bab-a607-13e5345233cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:27.084071 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8bf69759-960c-4bab-a607-13e5345233cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:27.085248 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8bf69759-960c-4bab-a607-13e5345233cf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.157633 Nov 24 16:13:27.085808 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 490/1000] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:26 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:27.207873 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-11adae00-3ce0-40e2-bf6a-d3e1189f6bfa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:27.208838 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-11adae00-3ce0-40e2-bf6a-d3e1189f6bfa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:27.216540 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-11adae00-3ce0-40e2-bf6a-d3e1189f6bfa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:27.217084 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-11adae00-3ce0-40e2-bf6a-d3e1189f6bfa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:27.217881 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-11adae00-3ce0-40e2-bf6a-d3e1189f6bfa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:27.218320 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-11adae00-3ce0-40e2-bf6a-d3e1189f6bfa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:27.277936 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-11adae00-3ce0-40e2-bf6a-d3e1189f6bfa tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.074042 Nov 24 16:13:27.279218 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 511/1001] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:27 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:28.105298 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4ad329d8-79b4-4f07-a9c5-fed03bdbca1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:28.106133 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4ad329d8-79b4-4f07-a9c5-fed03bdbca1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:28.113883 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ad329d8-79b4-4f07-a9c5-fed03bdbca1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:28.114337 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ad329d8-79b4-4f07-a9c5-fed03bdbca1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:28.115130 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ad329d8-79b4-4f07-a9c5-fed03bdbca1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:28.115569 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4ad329d8-79b4-4f07-a9c5-fed03bdbca1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:28.249475 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4ad329d8-79b4-4f07-a9c5-fed03bdbca1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:28.257298 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4ad329d8-79b4-4f07-a9c5-fed03bdbca1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:28.258836 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4ad329d8-79b4-4f07-a9c5-fed03bdbca1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:28.259972 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4ad329d8-79b4-4f07-a9c5-fed03bdbca1f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.158731 Nov 24 16:13:28.260524 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 491/1002] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:28 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:28.290681 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2a7abce2-fe66-4a48-85b1-5cd649593adf tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:28.292015 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2a7abce2-fe66-4a48-85b1-5cd649593adf tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:28.298862 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2a7abce2-fe66-4a48-85b1-5cd649593adf tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:28.299339 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2a7abce2-fe66-4a48-85b1-5cd649593adf tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:28.300135 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2a7abce2-fe66-4a48-85b1-5cd649593adf tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:28.300568 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2a7abce2-fe66-4a48-85b1-5cd649593adf tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:28.361776 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2a7abce2-fe66-4a48-85b1-5cd649593adf tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.074835 Nov 24 16:13:28.362350 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 512/1003] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:28 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:13:29.278234 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-04f009b6-4417-475d-8047-1585d20e4f1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:29.278861 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-04f009b6-4417-475d-8047-1585d20e4f1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:29.285924 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-04f009b6-4417-475d-8047-1585d20e4f1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:29.286375 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-04f009b6-4417-475d-8047-1585d20e4f1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:29.287174 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-04f009b6-4417-475d-8047-1585d20e4f1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:29.287615 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-04f009b6-4417-475d-8047-1585d20e4f1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:29.374403 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4dfcfb36-4f5e-45b1-aaf9-47206c7b24d9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:29.375422 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4dfcfb36-4f5e-45b1-aaf9-47206c7b24d9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:29.382423 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4dfcfb36-4f5e-45b1-aaf9-47206c7b24d9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:29.382872 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4dfcfb36-4f5e-45b1-aaf9-47206c7b24d9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:29.383655 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4dfcfb36-4f5e-45b1-aaf9-47206c7b24d9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:29.384085 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4dfcfb36-4f5e-45b1-aaf9-47206c7b24d9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:29.425454 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-04f009b6-4417-475d-8047-1585d20e4f1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:29.433354 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-04f009b6-4417-475d-8047-1585d20e4f1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:29.434865 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-04f009b6-4417-475d-8047-1585d20e4f1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:29.436450 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-04f009b6-4417-475d-8047-1585d20e4f1e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.161858 Nov 24 16:13:29.437016 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 492/1004] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:29 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:29.446211 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4dfcfb36-4f5e-45b1-aaf9-47206c7b24d9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.076135 Nov 24 16:13:29.447053 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 513/1005] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:29 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:13:30.455548 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d3aa91b1-e306-4a81-ba7d-db74058868c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:30.456130 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d3aa91b1-e306-4a81-ba7d-db74058868c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:30.458418 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c02de921-85df-4868-b649-cafc43e7f68c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:30.459415 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c02de921-85df-4868-b649-cafc43e7f68c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:30.462508 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3aa91b1-e306-4a81-ba7d-db74058868c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:30.462895 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3aa91b1-e306-4a81-ba7d-db74058868c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:30.463672 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3aa91b1-e306-4a81-ba7d-db74058868c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:30.464101 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d3aa91b1-e306-4a81-ba7d-db74058868c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:30.466238 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c02de921-85df-4868-b649-cafc43e7f68c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:30.467316 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c02de921-85df-4868-b649-cafc43e7f68c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:30.468470 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c02de921-85df-4868-b649-cafc43e7f68c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:30.468910 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c02de921-85df-4868-b649-cafc43e7f68c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:30.531307 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c02de921-85df-4868-b649-cafc43e7f68c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.076671 Nov 24 16:13:30.532496 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 514/1006] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:30 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:13:30.595404 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d3aa91b1-e306-4a81-ba7d-db74058868c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:30.603188 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d3aa91b1-e306-4a81-ba7d-db74058868c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:30.604695 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d3aa91b1-e306-4a81-ba7d-db74058868c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:30.605877 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d3aa91b1-e306-4a81-ba7d-db74058868c0 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.154677 Nov 24 16:13:30.606444 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 493/1007] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:30 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:31.543462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-52abe6c0-8516-40e6-aa97-254cf7174dd1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:31.544366 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-52abe6c0-8516-40e6-aa97-254cf7174dd1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:31.552422 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-52abe6c0-8516-40e6-aa97-254cf7174dd1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:31.552866 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-52abe6c0-8516-40e6-aa97-254cf7174dd1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:31.553745 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-52abe6c0-8516-40e6-aa97-254cf7174dd1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:31.554265 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-52abe6c0-8516-40e6-aa97-254cf7174dd1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:31.614174 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-52abe6c0-8516-40e6-aa97-254cf7174dd1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.074601 Nov 24 16:13:31.614822 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 515/1008] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:31 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:31.624260 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5752f441-7284-4744-ab45-c9f5502636e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:31.624870 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5752f441-7284-4744-ab45-c9f5502636e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:31.631257 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5752f441-7284-4744-ab45-c9f5502636e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:31.631718 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5752f441-7284-4744-ab45-c9f5502636e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:31.632504 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5752f441-7284-4744-ab45-c9f5502636e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:31.632947 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5752f441-7284-4744-ab45-c9f5502636e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:31.761574 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5752f441-7284-4744-ab45-c9f5502636e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:31.769693 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5752f441-7284-4744-ab45-c9f5502636e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:31.771209 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5752f441-7284-4744-ab45-c9f5502636e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:31.772375 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5752f441-7284-4744-ab45-c9f5502636e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.152775 Nov 24 16:13:31.772941 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 494/1009] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:31 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:32.627171 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a58825dd-51e6-4123-9407-d9e4463c165a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:32.628073 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a58825dd-51e6-4123-9407-d9e4463c165a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:32.635302 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a58825dd-51e6-4123-9407-d9e4463c165a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:32.635745 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a58825dd-51e6-4123-9407-d9e4463c165a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:32.636537 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a58825dd-51e6-4123-9407-d9e4463c165a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:32.636977 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a58825dd-51e6-4123-9407-d9e4463c165a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:32.702323 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a58825dd-51e6-4123-9407-d9e4463c165a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.078728 Nov 24 16:13:32.702977 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 516/1010] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:32 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:32.790718 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-155f3c76-6b5d-4f8f-8af0-767cd13b7f7f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:32.791314 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-155f3c76-6b5d-4f8f-8af0-767cd13b7f7f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:32.797862 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-155f3c76-6b5d-4f8f-8af0-767cd13b7f7f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:32.798314 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-155f3c76-6b5d-4f8f-8af0-767cd13b7f7f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:32.799097 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-155f3c76-6b5d-4f8f-8af0-767cd13b7f7f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:32.799536 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-155f3c76-6b5d-4f8f-8af0-767cd13b7f7f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:32.932840 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-155f3c76-6b5d-4f8f-8af0-767cd13b7f7f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:32.941673 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-155f3c76-6b5d-4f8f-8af0-767cd13b7f7f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:32.943164 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-155f3c76-6b5d-4f8f-8af0-767cd13b7f7f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:32.944322 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-155f3c76-6b5d-4f8f-8af0-767cd13b7f7f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.157318 Nov 24 16:13:32.944881 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 495/1011] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:32 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:33.714631 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1e9a937e-9c10-4b94-b2b2-138d1a1d8c7a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:33.715625 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1e9a937e-9c10-4b94-b2b2-138d1a1d8c7a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:33.723179 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1e9a937e-9c10-4b94-b2b2-138d1a1d8c7a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:33.723617 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1e9a937e-9c10-4b94-b2b2-138d1a1d8c7a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:33.724394 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1e9a937e-9c10-4b94-b2b2-138d1a1d8c7a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:33.724820 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1e9a937e-9c10-4b94-b2b2-138d1a1d8c7a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:33.788479 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1e9a937e-9c10-4b94-b2b2-138d1a1d8c7a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.077718 Nov 24 16:13:33.789444 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 517/1012] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:33 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:33.963587 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a3e45e50-be99-4609-a276-299cc2d0a937 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:33.964173 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a3e45e50-be99-4609-a276-299cc2d0a937 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:33.971164 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3e45e50-be99-4609-a276-299cc2d0a937 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:33.971552 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3e45e50-be99-4609-a276-299cc2d0a937 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:33.972342 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3e45e50-be99-4609-a276-299cc2d0a937 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:33.972782 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a3e45e50-be99-4609-a276-299cc2d0a937 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:34.101963 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a3e45e50-be99-4609-a276-299cc2d0a937 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:34.110108 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a3e45e50-be99-4609-a276-299cc2d0a937 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:34.111607 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a3e45e50-be99-4609-a276-299cc2d0a937 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:34.112753 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a3e45e50-be99-4609-a276-299cc2d0a937 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.152963 Nov 24 16:13:34.113360 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 496/1013] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:33 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:34.801236 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-285d99cc-01dc-4c4a-942a-e07bac01b785 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:34.802232 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-285d99cc-01dc-4c4a-942a-e07bac01b785 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:34.809468 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-285d99cc-01dc-4c4a-942a-e07bac01b785 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:34.809919 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-285d99cc-01dc-4c4a-942a-e07bac01b785 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:34.811590 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-285d99cc-01dc-4c4a-942a-e07bac01b785 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:34.812052 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-285d99cc-01dc-4c4a-942a-e07bac01b785 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:34.878098 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-285d99cc-01dc-4c4a-942a-e07bac01b785 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.080746 Nov 24 16:13:34.878739 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 518/1014] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:34 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:35.131167 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-306367c7-881b-4016-882c-ae052c414425 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:35.131878 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-306367c7-881b-4016-882c-ae052c414425 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:35.138345 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-306367c7-881b-4016-882c-ae052c414425 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:35.139362 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-306367c7-881b-4016-882c-ae052c414425 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:35.140141 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-306367c7-881b-4016-882c-ae052c414425 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:35.140565 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-306367c7-881b-4016-882c-ae052c414425 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:35.276302 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-306367c7-881b-4016-882c-ae052c414425 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:35.284664 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-306367c7-881b-4016-882c-ae052c414425 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:35.286231 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-306367c7-881b-4016-882c-ae052c414425 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:35.287380 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-306367c7-881b-4016-882c-ae052c414425 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.159946 Nov 24 16:13:35.287944 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 497/1015] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:35 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:35.891626 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7006f50d-f6db-44b9-88ec-82c86bb310b7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:35.892624 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7006f50d-f6db-44b9-88ec-82c86bb310b7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:35.899793 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7006f50d-f6db-44b9-88ec-82c86bb310b7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:35.900235 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7006f50d-f6db-44b9-88ec-82c86bb310b7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:35.901040 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7006f50d-f6db-44b9-88ec-82c86bb310b7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:35.901479 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7006f50d-f6db-44b9-88ec-82c86bb310b7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:35.961869 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7006f50d-f6db-44b9-88ec-82c86bb310b7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.074921 Nov 24 16:13:35.962523 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 519/1016] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:35 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:36.305356 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8d51cc82-0192-4e8b-9984-829a0c092ee9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:36.305946 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8d51cc82-0192-4e8b-9984-829a0c092ee9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:36.312610 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8d51cc82-0192-4e8b-9984-829a0c092ee9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:36.313082 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8d51cc82-0192-4e8b-9984-829a0c092ee9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:36.313867 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8d51cc82-0192-4e8b-9984-829a0c092ee9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:36.314307 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8d51cc82-0192-4e8b-9984-829a0c092ee9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:36.442969 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8d51cc82-0192-4e8b-9984-829a0c092ee9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:36.451142 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8d51cc82-0192-4e8b-9984-829a0c092ee9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:36.452812 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8d51cc82-0192-4e8b-9984-829a0c092ee9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:36.453973 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8d51cc82-0192-4e8b-9984-829a0c092ee9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.152385 Nov 24 16:13:36.454570 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 498/1017] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:36 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:36.975852 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c90215d7-e90b-4aae-bdf4-bf8691b1ca16 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:36.976847 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c90215d7-e90b-4aae-bdf4-bf8691b1ca16 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:36.984108 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c90215d7-e90b-4aae-bdf4-bf8691b1ca16 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:36.984565 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c90215d7-e90b-4aae-bdf4-bf8691b1ca16 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:36.985397 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c90215d7-e90b-4aae-bdf4-bf8691b1ca16 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:36.985838 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c90215d7-e90b-4aae-bdf4-bf8691b1ca16 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:37.047952 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c90215d7-e90b-4aae-bdf4-bf8691b1ca16 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.076041 Nov 24 16:13:37.048610 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 520/1018] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:36 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:37.472826 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a8749014-3f4b-4d1e-af37-8af7e466b900 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:37.473445 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a8749014-3f4b-4d1e-af37-8af7e466b900 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:37.482629 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a8749014-3f4b-4d1e-af37-8af7e466b900 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:37.483074 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a8749014-3f4b-4d1e-af37-8af7e466b900 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:37.484813 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a8749014-3f4b-4d1e-af37-8af7e466b900 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:37.485332 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a8749014-3f4b-4d1e-af37-8af7e466b900 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:37.641054 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a8749014-3f4b-4d1e-af37-8af7e466b900 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:37.650439 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a8749014-3f4b-4d1e-af37-8af7e466b900 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:37.651936 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a8749014-3f4b-4d1e-af37-8af7e466b900 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:37.653107 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a8749014-3f4b-4d1e-af37-8af7e466b900 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1743 microversion: 2.20 time: 0.184990 Nov 24 16:13:37.653675 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 499/1019] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:37 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1743 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:38.061482 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-606e2e69-6581-4bbf-b414-1f9fde37b1c9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:38.063051 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-606e2e69-6581-4bbf-b414-1f9fde37b1c9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:38.071133 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-606e2e69-6581-4bbf-b414-1f9fde37b1c9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:38.071733 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-606e2e69-6581-4bbf-b414-1f9fde37b1c9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:38.072543 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-606e2e69-6581-4bbf-b414-1f9fde37b1c9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:38.073059 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-606e2e69-6581-4bbf-b414-1f9fde37b1c9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:38.142793 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-606e2e69-6581-4bbf-b414-1f9fde37b1c9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.086082 Nov 24 16:13:38.143453 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 521/1020] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:38 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:38.670370 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e5e8149f-60ca-4c10-93dd-f4c3d31e58a8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:38.671646 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e5e8149f-60ca-4c10-93dd-f4c3d31e58a8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:38.678040 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e5e8149f-60ca-4c10-93dd-f4c3d31e58a8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:38.678488 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e5e8149f-60ca-4c10-93dd-f4c3d31e58a8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:38.679277 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e5e8149f-60ca-4c10-93dd-f4c3d31e58a8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:38.679717 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e5e8149f-60ca-4c10-93dd-f4c3d31e58a8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:38.813655 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e5e8149f-60ca-4c10-93dd-f4c3d31e58a8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:38.821436 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e5e8149f-60ca-4c10-93dd-f4c3d31e58a8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:38.822934 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e5e8149f-60ca-4c10-93dd-f4c3d31e58a8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:38.824082 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e5e8149f-60ca-4c10-93dd-f4c3d31e58a8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1743 microversion: 2.20 time: 0.157466 Nov 24 16:13:38.824666 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 500/1021] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:38 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:39.155071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5a4717dc-b9af-4124-80ec-09e87f9ac5f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:39.157190 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5a4717dc-b9af-4124-80ec-09e87f9ac5f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:39.164388 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5a4717dc-b9af-4124-80ec-09e87f9ac5f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:39.164842 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5a4717dc-b9af-4124-80ec-09e87f9ac5f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:39.165654 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5a4717dc-b9af-4124-80ec-09e87f9ac5f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:39.166090 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5a4717dc-b9af-4124-80ec-09e87f9ac5f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:39.233818 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5a4717dc-b9af-4124-80ec-09e87f9ac5f5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.082078 Nov 24 16:13:39.234569 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 522/1022] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:39 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:13:39.841985 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ffef7121-4592-4b4b-ba62-75658d4aad66 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:39.842612 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ffef7121-4592-4b4b-ba62-75658d4aad66 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:39.849575 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffef7121-4592-4b4b-ba62-75658d4aad66 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:39.850027 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffef7121-4592-4b4b-ba62-75658d4aad66 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:39.850845 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffef7121-4592-4b4b-ba62-75658d4aad66 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:39.851284 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffef7121-4592-4b4b-ba62-75658d4aad66 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:39.979770 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ffef7121-4592-4b4b-ba62-75658d4aad66 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:39.990412 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ffef7121-4592-4b4b-ba62-75658d4aad66 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:39.992044 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ffef7121-4592-4b4b-ba62-75658d4aad66 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:39.993386 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ffef7121-4592-4b4b-ba62-75658d4aad66 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1743 microversion: 2.20 time: 0.155185 Nov 24 16:13:39.993965 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 501/1023] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:39 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:40.247058 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e0d28c4b-291b-4fa6-add0-f7c28994945b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:40.248061 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e0d28c4b-291b-4fa6-add0-f7c28994945b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:40.256308 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e0d28c4b-291b-4fa6-add0-f7c28994945b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:40.256754 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e0d28c4b-291b-4fa6-add0-f7c28994945b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:40.257587 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e0d28c4b-291b-4fa6-add0-f7c28994945b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:40.258018 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e0d28c4b-291b-4fa6-add0-f7c28994945b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:40.323335 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e0d28c4b-291b-4fa6-add0-f7c28994945b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.080385 Nov 24 16:13:40.323977 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 523/1024] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:40 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:41.011659 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a182e9c4-91b3-40e9-a853-f83eee9fb0ed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:41.012257 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a182e9c4-91b3-40e9-a853-f83eee9fb0ed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:41.018622 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a182e9c4-91b3-40e9-a853-f83eee9fb0ed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:41.019065 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a182e9c4-91b3-40e9-a853-f83eee9fb0ed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:41.019849 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a182e9c4-91b3-40e9-a853-f83eee9fb0ed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:41.020273 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a182e9c4-91b3-40e9-a853-f83eee9fb0ed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:41.156576 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a182e9c4-91b3-40e9-a853-f83eee9fb0ed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:41.164408 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a182e9c4-91b3-40e9-a853-f83eee9fb0ed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:41.165924 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a182e9c4-91b3-40e9-a853-f83eee9fb0ed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:41.167072 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a182e9c4-91b3-40e9-a853-f83eee9fb0ed tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1743 microversion: 2.20 time: 0.159151 Nov 24 16:13:41.167631 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 502/1025] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:41 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:41.186110 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-59b6d5af-ed19-4662-ace5-b8711eb86330 req-8198aa76-19af-48b6-a13c-30dc44ef314e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-plugged", "status": "completed", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:41.188087 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:13:41.188087 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:13:41.196622 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-59b6d5af-ed19-4662-ace5-b8711eb86330 req-8198aa76-19af-48b6-a13c-30dc44ef314e service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:41.197386 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-59b6d5af-ed19-4662-ace5-b8711eb86330 req-8198aa76-19af-48b6-a13c-30dc44ef314e service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:41.208810 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-59b6d5af-ed19-4662-ace5-b8711eb86330 req-8198aa76-19af-48b6-a13c-30dc44ef314e service nova] Creating event network-vif-plugged:4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 for instance b62212ea-7c11-4095-adf5-a78b04d67de0 on hv-cinder-81899 Nov 24 16:13:41.214264 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-59b6d5af-ed19-4662-ace5-b8711eb86330 req-8198aa76-19af-48b6-a13c-30dc44ef314e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031906 Nov 24 16:13:41.214662 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 524/1026] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:13:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:13:41.335830 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-694ce15a-687a-41a1-a5e3-08059304863f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:41.336672 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-694ce15a-687a-41a1-a5e3-08059304863f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:41.343841 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-694ce15a-687a-41a1-a5e3-08059304863f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:41.344484 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-694ce15a-687a-41a1-a5e3-08059304863f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:41.345316 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-694ce15a-687a-41a1-a5e3-08059304863f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:41.345782 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-694ce15a-687a-41a1-a5e3-08059304863f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:41.409653 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-694ce15a-687a-41a1-a5e3-08059304863f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.077342 Nov 24 16:13:41.410339 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 503/1027] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:41 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:42.186164 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3032a2fb-4056-4b51-9710-5244b282fd63 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:42.187541 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3032a2fb-4056-4b51-9710-5244b282fd63 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:42.193760 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3032a2fb-4056-4b51-9710-5244b282fd63 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:42.194208 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3032a2fb-4056-4b51-9710-5244b282fd63 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:42.194988 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3032a2fb-4056-4b51-9710-5244b282fd63 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:42.195421 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3032a2fb-4056-4b51-9710-5244b282fd63 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:42.330330 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3032a2fb-4056-4b51-9710-5244b282fd63 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:42.338418 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3032a2fb-4056-4b51-9710-5244b282fd63 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:42.339922 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3032a2fb-4056-4b51-9710-5244b282fd63 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:42.341103 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3032a2fb-4056-4b51-9710-5244b282fd63 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1743 microversion: 2.20 time: 0.159518 Nov 24 16:13:42.341670 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 525/1028] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:42 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:42.422469 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-56b4444e-1a2b-4279-9497-212232d45ab9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:42.423458 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-56b4444e-1a2b-4279-9497-212232d45ab9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:42.430291 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56b4444e-1a2b-4279-9497-212232d45ab9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:42.430736 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56b4444e-1a2b-4279-9497-212232d45ab9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:42.431509 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56b4444e-1a2b-4279-9497-212232d45ab9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:42.431936 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-56b4444e-1a2b-4279-9497-212232d45ab9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:42.494169 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-56b4444e-1a2b-4279-9497-212232d45ab9 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.076046 Nov 24 16:13:42.494976 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 504/1029] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:42 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:43.360651 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6b28d5e8-c66c-4519-8819-a17e01762071 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:43.362214 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6b28d5e8-c66c-4519-8819-a17e01762071 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:43.369661 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6b28d5e8-c66c-4519-8819-a17e01762071 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:43.370477 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6b28d5e8-c66c-4519-8819-a17e01762071 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:43.371578 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6b28d5e8-c66c-4519-8819-a17e01762071 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:43.372588 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6b28d5e8-c66c-4519-8819-a17e01762071 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:43.507047 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a726554a-12f0-4323-974f-95b9af4ed1b3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:43.511343 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a726554a-12f0-4323-974f-95b9af4ed1b3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:43.519898 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a726554a-12f0-4323-974f-95b9af4ed1b3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:43.520615 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6b28d5e8-c66c-4519-8819-a17e01762071 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:43.521061 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a726554a-12f0-4323-974f-95b9af4ed1b3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:43.522197 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a726554a-12f0-4323-974f-95b9af4ed1b3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:43.522636 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a726554a-12f0-4323-974f-95b9af4ed1b3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:43.531443 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6b28d5e8-c66c-4519-8819-a17e01762071 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:43.533634 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6b28d5e8-c66c-4519-8819-a17e01762071 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:43.535185 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6b28d5e8-c66c-4519-8819-a17e01762071 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1738 microversion: 2.20 time: 0.179419 Nov 24 16:13:43.536545 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 526/1030] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:43 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:43.592005 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a726554a-12f0-4323-974f-95b9af4ed1b3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.088918 Nov 24 16:13:43.593314 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 505/1031] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:43 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:13:44.554528 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b38e30de-29dd-4fee-a34a-aec408b72f57 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:44.555528 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b38e30de-29dd-4fee-a34a-aec408b72f57 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:44.562841 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b38e30de-29dd-4fee-a34a-aec408b72f57 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:44.563601 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b38e30de-29dd-4fee-a34a-aec408b72f57 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:44.565328 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b38e30de-29dd-4fee-a34a-aec408b72f57 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:44.567326 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b38e30de-29dd-4fee-a34a-aec408b72f57 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:44.608834 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-916e5706-dafc-4d65-b9ed-e0d421a1c473 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:44.610844 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-916e5706-dafc-4d65-b9ed-e0d421a1c473 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:44.619236 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-916e5706-dafc-4d65-b9ed-e0d421a1c473 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:44.620034 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-916e5706-dafc-4d65-b9ed-e0d421a1c473 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:44.621212 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-916e5706-dafc-4d65-b9ed-e0d421a1c473 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:44.622121 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-916e5706-dafc-4d65-b9ed-e0d421a1c473 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:44.691820 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-916e5706-dafc-4d65-b9ed-e0d421a1c473 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.091006 Nov 24 16:13:44.693908 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 506/1032] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:44 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:44.724624 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b38e30de-29dd-4fee-a34a-aec408b72f57 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:44.735971 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b38e30de-29dd-4fee-a34a-aec408b72f57 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:44.738478 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b38e30de-29dd-4fee-a34a-aec408b72f57 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:44.740437 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b38e30de-29dd-4fee-a34a-aec408b72f57 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1738 microversion: 2.20 time: 0.189757 Nov 24 16:13:44.741112 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 527/1033] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:44 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:45.707519 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4b2734c1-272f-4681-ad18-170d46310665 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:45.708522 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4b2734c1-272f-4681-ad18-170d46310665 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:45.719367 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4b2734c1-272f-4681-ad18-170d46310665 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:45.719367 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4b2734c1-272f-4681-ad18-170d46310665 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:45.725683 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4b2734c1-272f-4681-ad18-170d46310665 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:45.726438 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-4b2734c1-272f-4681-ad18-170d46310665 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:45.766886 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f95698a0-fdef-4759-b5e9-9267fc477a7e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:45.767547 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f95698a0-fdef-4759-b5e9-9267fc477a7e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:45.777430 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f95698a0-fdef-4759-b5e9-9267fc477a7e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:45.778040 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f95698a0-fdef-4759-b5e9-9267fc477a7e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:45.779071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f95698a0-fdef-4759-b5e9-9267fc477a7e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:45.779628 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f95698a0-fdef-4759-b5e9-9267fc477a7e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:45.806121 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4b2734c1-272f-4681-ad18-170d46310665 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 28613 microversion: 2.1 time: 0.102589 Nov 24 16:13:45.807062 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 507/1034] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:45 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 28613 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:13:45.954434 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-f95698a0-fdef-4759-b5e9-9267fc477a7e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:45.962572 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-f95698a0-fdef-4759-b5e9-9267fc477a7e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:45.964217 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-f95698a0-fdef-4759-b5e9-9267fc477a7e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:45.965452 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f95698a0-fdef-4759-b5e9-9267fc477a7e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1738 microversion: 2.20 time: 0.205118 Nov 24 16:13:45.966014 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 528/1035] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:45 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:13:46.821349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-52652a08-a914-4750-8af5-28f129a032b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:46.823077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-52652a08-a914-4750-8af5-28f129a032b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:46.830868 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-52652a08-a914-4750-8af5-28f129a032b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:46.831693 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-52652a08-a914-4750-8af5-28f129a032b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:46.832874 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-52652a08-a914-4750-8af5-28f129a032b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:46.833561 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-52652a08-a914-4750-8af5-28f129a032b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:46.921547 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-52652a08-a914-4750-8af5-28f129a032b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 30144 microversion: 2.1 time: 0.105349 Nov 24 16:13:46.922286 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 508/1036] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:46 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 30144 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:46.983874 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9c0487a1-e69a-4e46-a1ca-6ee7dbca5a83 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:46.985365 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9c0487a1-e69a-4e46-a1ca-6ee7dbca5a83 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:46.994347 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c0487a1-e69a-4e46-a1ca-6ee7dbca5a83 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:46.995424 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c0487a1-e69a-4e46-a1ca-6ee7dbca5a83 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:46.996231 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c0487a1-e69a-4e46-a1ca-6ee7dbca5a83 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:46.996988 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c0487a1-e69a-4e46-a1ca-6ee7dbca5a83 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:47.145895 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9c0487a1-e69a-4e46-a1ca-6ee7dbca5a83 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:47.154354 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9c0487a1-e69a-4e46-a1ca-6ee7dbca5a83 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:47.156914 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9c0487a1-e69a-4e46-a1ca-6ee7dbca5a83 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:47.158333 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9c0487a1-e69a-4e46-a1ca-6ee7dbca5a83 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1738 microversion: 2.20 time: 0.178360 Nov 24 16:13:47.160109 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 529/1037] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:46 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:47.934458 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-378cabc8-b5e0-4f53-81ec-93792647aacd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:47.936971 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-378cabc8-b5e0-4f53-81ec-93792647aacd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:47.944532 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-378cabc8-b5e0-4f53-81ec-93792647aacd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:47.945385 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-378cabc8-b5e0-4f53-81ec-93792647aacd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:47.946448 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-378cabc8-b5e0-4f53-81ec-93792647aacd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:47.946959 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-378cabc8-b5e0-4f53-81ec-93792647aacd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:48.028336 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-378cabc8-b5e0-4f53-81ec-93792647aacd tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 32013 microversion: 2.1 time: 0.097820 Nov 24 16:13:48.029361 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 509/1038] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:47 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 32013 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:13:48.182016 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8d2f07e3-b932-449e-8fbc-cd942138b93a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:48.182640 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8d2f07e3-b932-449e-8fbc-cd942138b93a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:48.190103 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8d2f07e3-b932-449e-8fbc-cd942138b93a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:48.190619 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8d2f07e3-b932-449e-8fbc-cd942138b93a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:48.191216 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8d2f07e3-b932-449e-8fbc-cd942138b93a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:48.191770 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8d2f07e3-b932-449e-8fbc-cd942138b93a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:48.359723 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8d2f07e3-b932-449e-8fbc-cd942138b93a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:48.370435 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8d2f07e3-b932-449e-8fbc-cd942138b93a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:48.372201 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8d2f07e3-b932-449e-8fbc-cd942138b93a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:48.373538 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8d2f07e3-b932-449e-8fbc-cd942138b93a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1738 microversion: 2.20 time: 0.201453 Nov 24 16:13:48.374436 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 530/1039] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:48 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:49.043292 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5c3ba899-2919-461c-9c71-3c9d39668143 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:49.045828 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5c3ba899-2919-461c-9c71-3c9d39668143 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:49.054349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5c3ba899-2919-461c-9c71-3c9d39668143 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:49.055190 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5c3ba899-2919-461c-9c71-3c9d39668143 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:49.056119 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5c3ba899-2919-461c-9c71-3c9d39668143 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:49.056791 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5c3ba899-2919-461c-9c71-3c9d39668143 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:49.135998 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5c3ba899-2919-461c-9c71-3c9d39668143 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 33369 microversion: 2.1 time: 0.097293 Nov 24 16:13:49.137368 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 510/1040] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:49 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 33369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:49.392890 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4f33a34e-88e0-4231-834a-a0769f21faa7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:49.393668 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4f33a34e-88e0-4231-834a-a0769f21faa7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:49.400121 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4f33a34e-88e0-4231-834a-a0769f21faa7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:49.400578 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4f33a34e-88e0-4231-834a-a0769f21faa7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:49.401417 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4f33a34e-88e0-4231-834a-a0769f21faa7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:49.402037 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4f33a34e-88e0-4231-834a-a0769f21faa7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:49.553003 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4f33a34e-88e0-4231-834a-a0769f21faa7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:49.562443 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4f33a34e-88e0-4231-834a-a0769f21faa7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:49.564323 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4f33a34e-88e0-4231-834a-a0769f21faa7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:49.565525 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4f33a34e-88e0-4231-834a-a0769f21faa7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1738 microversion: 2.20 time: 0.176750 Nov 24 16:13:49.566638 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 531/1041] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:49 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:50.150693 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-78664364-80b7-4147-be3d-d7f4083b6373 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:50.152351 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-78664364-80b7-4147-be3d-d7f4083b6373 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:50.160351 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-78664364-80b7-4147-be3d-d7f4083b6373 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:50.160807 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-78664364-80b7-4147-be3d-d7f4083b6373 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:50.161724 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-78664364-80b7-4147-be3d-d7f4083b6373 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:50.162089 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-78664364-80b7-4147-be3d-d7f4083b6373 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:50.246240 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-78664364-80b7-4147-be3d-d7f4083b6373 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 34419 microversion: 2.1 time: 0.099340 Nov 24 16:13:50.247359 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 511/1042] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:50 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 34419 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:50.597820 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-a0240720-18f7-4699-897b-278169fa85e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:50.598674 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-a0240720-18f7-4699-897b-278169fa85e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:50.605715 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a0240720-18f7-4699-897b-278169fa85e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:50.606313 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a0240720-18f7-4699-897b-278169fa85e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:50.607242 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a0240720-18f7-4699-897b-278169fa85e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:50.607787 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-a0240720-18f7-4699-897b-278169fa85e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:50.751144 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a0240720-18f7-4699-897b-278169fa85e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:50.761636 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a0240720-18f7-4699-897b-278169fa85e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:50.763990 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-a0240720-18f7-4699-897b-278169fa85e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:50.766165 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-a0240720-18f7-4699-897b-278169fa85e9 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1738 microversion: 2.20 time: 0.174287 Nov 24 16:13:50.766768 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 532/1043] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:50 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:51.262419 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8952ce91-a892-43f7-997e-213b731b8d7d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:51.266949 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8952ce91-a892-43f7-997e-213b731b8d7d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:51.281771 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8952ce91-a892-43f7-997e-213b731b8d7d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:51.282268 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8952ce91-a892-43f7-997e-213b731b8d7d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:51.283133 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8952ce91-a892-43f7-997e-213b731b8d7d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:51.286138 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8952ce91-a892-43f7-997e-213b731b8d7d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:51.368566 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8952ce91-a892-43f7-997e-213b731b8d7d tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 35484 microversion: 2.1 time: 0.110077 Nov 24 16:13:51.370360 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 512/1044] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:51 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 35484 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:51.788634 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3f424ce5-5dd0-4115-92db-e366ffa3da74 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:51.789585 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3f424ce5-5dd0-4115-92db-e366ffa3da74 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:51.798950 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f424ce5-5dd0-4115-92db-e366ffa3da74 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:51.799782 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f424ce5-5dd0-4115-92db-e366ffa3da74 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:51.801601 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f424ce5-5dd0-4115-92db-e366ffa3da74 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:51.802283 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3f424ce5-5dd0-4115-92db-e366ffa3da74 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:51.968930 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3f424ce5-5dd0-4115-92db-e366ffa3da74 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:51.980567 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3f424ce5-5dd0-4115-92db-e366ffa3da74 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:51.983496 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3f424ce5-5dd0-4115-92db-e366ffa3da74 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:51.985591 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3f424ce5-5dd0-4115-92db-e366ffa3da74 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1738 microversion: 2.20 time: 0.201329 Nov 24 16:13:51.986551 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 533/1045] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:51 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:52.381298 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d75ce18f-67b5-4334-a9ac-4c62a04b1013 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:52.382286 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d75ce18f-67b5-4334-a9ac-4c62a04b1013 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:52.389955 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d75ce18f-67b5-4334-a9ac-4c62a04b1013 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:52.390411 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d75ce18f-67b5-4334-a9ac-4c62a04b1013 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:52.391194 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d75ce18f-67b5-4334-a9ac-4c62a04b1013 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:52.391634 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d75ce18f-67b5-4334-a9ac-4c62a04b1013 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:52.471265 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d75ce18f-67b5-4334-a9ac-4c62a04b1013 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 36900 microversion: 2.1 time: 0.093940 Nov 24 16:13:52.471844 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 513/1046] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:52 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 36900 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:53.006662 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9c9e29dc-5cea-4d10-89fd-4f729227a87e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:53.007356 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9c9e29dc-5cea-4d10-89fd-4f729227a87e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:53.014675 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c9e29dc-5cea-4d10-89fd-4f729227a87e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:53.015134 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c9e29dc-5cea-4d10-89fd-4f729227a87e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:53.016591 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c9e29dc-5cea-4d10-89fd-4f729227a87e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:53.017021 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9c9e29dc-5cea-4d10-89fd-4f729227a87e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:53.151663 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9c9e29dc-5cea-4d10-89fd-4f729227a87e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:53.160661 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9c9e29dc-5cea-4d10-89fd-4f729227a87e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:53.162184 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9c9e29dc-5cea-4d10-89fd-4f729227a87e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:53.163355 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9c9e29dc-5cea-4d10-89fd-4f729227a87e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1738 microversion: 2.20 time: 0.160852 Nov 24 16:13:53.163913 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 534/1047] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:53 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:53.484987 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-227c4944-9407-4de5-b35b-06c2fcf2f2d7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:53.486138 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-227c4944-9407-4de5-b35b-06c2fcf2f2d7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:53.493467 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-227c4944-9407-4de5-b35b-06c2fcf2f2d7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:53.493987 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-227c4944-9407-4de5-b35b-06c2fcf2f2d7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:53.494755 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-227c4944-9407-4de5-b35b-06c2fcf2f2d7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:53.495184 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-227c4944-9407-4de5-b35b-06c2fcf2f2d7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:53.564755 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-227c4944-9407-4de5-b35b-06c2fcf2f2d7 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 38147 microversion: 2.1 time: 0.084729 Nov 24 16:13:53.565512 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 514/1048] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:53 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 38147 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:54.181182 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-45f18497-7a75-40ab-ac92-fc6f2254a6d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:54.181785 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-45f18497-7a75-40ab-ac92-fc6f2254a6d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:54.188764 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-45f18497-7a75-40ab-ac92-fc6f2254a6d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:54.189461 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-45f18497-7a75-40ab-ac92-fc6f2254a6d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:54.190245 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-45f18497-7a75-40ab-ac92-fc6f2254a6d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:54.190680 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-45f18497-7a75-40ab-ac92-fc6f2254a6d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:54.335785 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-45f18497-7a75-40ab-ac92-fc6f2254a6d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:54.344628 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-45f18497-7a75-40ab-ac92-fc6f2254a6d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:54.346173 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-45f18497-7a75-40ab-ac92-fc6f2254a6d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:54.347446 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-45f18497-7a75-40ab-ac92-fc6f2254a6d4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1720 microversion: 2.20 time: 0.170041 Nov 24 16:13:54.347879 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 535/1049] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:54 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:54.578926 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2e13c5af-0575-4a04-ac85-aeceaf3d3e96 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:54.579990 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2e13c5af-0575-4a04-ac85-aeceaf3d3e96 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:54.587244 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e13c5af-0575-4a04-ac85-aeceaf3d3e96 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:54.587723 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e13c5af-0575-4a04-ac85-aeceaf3d3e96 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:54.588521 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e13c5af-0575-4a04-ac85-aeceaf3d3e96 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:54.588960 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2e13c5af-0575-4a04-ac85-aeceaf3d3e96 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:54.651000 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2e13c5af-0575-4a04-ac85-aeceaf3d3e96 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 38147 microversion: 2.1 time: 0.077038 Nov 24 16:13:54.651770 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 515/1050] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:54 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 38147 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:55.365785 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1700b8fd-8d07-4443-a63f-350a1adf7964 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:55.366370 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1700b8fd-8d07-4443-a63f-350a1adf7964 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:55.373499 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1700b8fd-8d07-4443-a63f-350a1adf7964 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:55.374024 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1700b8fd-8d07-4443-a63f-350a1adf7964 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:55.374951 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1700b8fd-8d07-4443-a63f-350a1adf7964 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:55.375618 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1700b8fd-8d07-4443-a63f-350a1adf7964 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:55.519187 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1700b8fd-8d07-4443-a63f-350a1adf7964 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:55.529823 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1700b8fd-8d07-4443-a63f-350a1adf7964 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:55.531352 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1700b8fd-8d07-4443-a63f-350a1adf7964 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:55.532646 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1700b8fd-8d07-4443-a63f-350a1adf7964 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1720 microversion: 2.20 time: 0.170657 Nov 24 16:13:55.533256 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 536/1051] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:55 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:55.664468 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-006ebc75-13e7-40d2-be9f-26e6a6e36b9b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:55.665487 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-006ebc75-13e7-40d2-be9f-26e6a6e36b9b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:55.673060 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-006ebc75-13e7-40d2-be9f-26e6a6e36b9b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:55.673495 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-006ebc75-13e7-40d2-be9f-26e6a6e36b9b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:55.674285 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-006ebc75-13e7-40d2-be9f-26e6a6e36b9b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:55.674720 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-006ebc75-13e7-40d2-be9f-26e6a6e36b9b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:55.736415 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-006ebc75-13e7-40d2-be9f-26e6a6e36b9b tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 38147 microversion: 2.1 time: 0.075948 Nov 24 16:13:55.737104 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 516/1052] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:55 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 38147 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:56.552832 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3d8e44e6-5cc8-4a87-ba17-d414d19fee3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:56.553462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3d8e44e6-5cc8-4a87-ba17-d414d19fee3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:56.561064 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3d8e44e6-5cc8-4a87-ba17-d414d19fee3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:56.561515 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3d8e44e6-5cc8-4a87-ba17-d414d19fee3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:56.562310 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3d8e44e6-5cc8-4a87-ba17-d414d19fee3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:56.562747 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3d8e44e6-5cc8-4a87-ba17-d414d19fee3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:56.696327 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3d8e44e6-5cc8-4a87-ba17-d414d19fee3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:56.705066 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3d8e44e6-5cc8-4a87-ba17-d414d19fee3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:56.706572 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3d8e44e6-5cc8-4a87-ba17-d414d19fee3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:56.707724 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3d8e44e6-5cc8-4a87-ba17-d414d19fee3b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1663 microversion: 2.20 time: 0.158773 Nov 24 16:13:56.708286 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 537/1053] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:56 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:56.726374 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-04514993-f0a6-4faf-8732-d914e6dfe6e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0015c0bf-ba75-4ea3-947e-f4cc0952dbda"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:56.727511 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-04514993-f0a6-4faf-8732-d914e6dfe6e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:56.734417 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-04514993-f0a6-4faf-8732-d914e6dfe6e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:56.734858 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-04514993-f0a6-4faf-8732-d914e6dfe6e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:56.735642 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-04514993-f0a6-4faf-8732-d914e6dfe6e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:56.736074 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-04514993-f0a6-4faf-8732-d914e6dfe6e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:56.747939 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3927c50c-02b7-48ef-9de5-ec0cacc16309 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:56.748872 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3927c50c-02b7-48ef-9de5-ec0cacc16309 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:56.755369 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3927c50c-02b7-48ef-9de5-ec0cacc16309 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:56.755820 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3927c50c-02b7-48ef-9de5-ec0cacc16309 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:56.756916 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3927c50c-02b7-48ef-9de5-ec0cacc16309 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:56.757401 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3927c50c-02b7-48ef-9de5-ec0cacc16309 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:56.818320 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3927c50c-02b7-48ef-9de5-ec0cacc16309 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 38147 microversion: 2.1 time: 0.074138 Nov 24 16:13:56.818985 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 538/1054] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:56 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 38147 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 16:13:57.018749 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-04514993-f0a6-4faf-8732-d914e6dfe6e5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296511 Nov 24 16:13:57.019406 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 517/1055] 10.222.0.72 () {62 vars in 1363 bytes} [Wed Nov 24 16:13:56 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:57.129911 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-379d5a24-1e9d-4505-ba1e-489c14536e29 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:57.130489 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-379d5a24-1e9d-4505-ba1e-489c14536e29 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:57.137451 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-379d5a24-1e9d-4505-ba1e-489c14536e29 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:57.137919 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-379d5a24-1e9d-4505-ba1e-489c14536e29 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:57.138692 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-379d5a24-1e9d-4505-ba1e-489c14536e29 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:57.139128 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-379d5a24-1e9d-4505-ba1e-489c14536e29 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:57.219716 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-b95da2c4-146f-4dc4-a72a-adae8c18db14 req-d180110a-99e8-46c0-81a7-a558f8a868c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-unplugged", "status": "completed", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:57.222395 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:13:57.222395 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:13:57.231735 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-b95da2c4-146f-4dc4-a72a-adae8c18db14 req-d180110a-99e8-46c0-81a7-a558f8a868c9 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:57.232455 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-b95da2c4-146f-4dc4-a72a-adae8c18db14 req-d180110a-99e8-46c0-81a7-a558f8a868c9 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:57.244837 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.compute.server_external_events [req-b95da2c4-146f-4dc4-a72a-adae8c18db14 req-d180110a-99e8-46c0-81a7-a558f8a868c9 service nova] Unable to find a host for instance b62212ea-7c11-4095-adf5-a78b04d67de0. Dropping event network-vif-unplugged {{(pid=116304) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 24 16:13:57.245886 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-b95da2c4-146f-4dc4-a72a-adae8c18db14 req-d180110a-99e8-46c0-81a7-a558f8a868c9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030226 Nov 24 16:13:57.246990 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 518/1056] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:13:57 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 24 16:13:57.366201 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-379d5a24-1e9d-4505-ba1e-489c14536e29 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/os-volume_attachments/0015c0bf-ba75-4ea3-947e-f4cc0952dbda" status: 202 len: 0 microversion: 2.20 time: 0.240916 Nov 24 16:13:57.366809 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 539/1057] 10.222.0.72 () {60 vars in 1456 bytes} [Wed Nov 24 16:13:57 2021] DELETE /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/os-volume_attachments/0015c0bf-ba75-4ea3-947e-f4cc0952dbda => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:13:57.420590 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-819b2c56-8b52-4657-bb19-523094e4341b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:57.421176 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-819b2c56-8b52-4657-bb19-523094e4341b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:57.428282 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-819b2c56-8b52-4657-bb19-523094e4341b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:57.428727 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-819b2c56-8b52-4657-bb19-523094e4341b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:57.429534 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-819b2c56-8b52-4657-bb19-523094e4341b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:57.429971 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-819b2c56-8b52-4657-bb19-523094e4341b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:57.523255 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-819b2c56-8b52-4657-bb19-523094e4341b tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action" status: 202 len: 0 microversion: 2.20 time: 0.106282 Nov 24 16:13:57.523903 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 519/1058] 10.222.0.72 () {62 vars in 1318 bytes} [Wed Nov 24 16:13:57 2021] POST /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:13:57.533052 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1c4f91ce-dd97-4cfb-b79e-2a292c455f0f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:57.533799 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1c4f91ce-dd97-4cfb-b79e-2a292c455f0f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:57.540631 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1c4f91ce-dd97-4cfb-b79e-2a292c455f0f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:57.541223 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1c4f91ce-dd97-4cfb-b79e-2a292c455f0f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:57.542101 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1c4f91ce-dd97-4cfb-b79e-2a292c455f0f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:57.542619 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1c4f91ce-dd97-4cfb-b79e-2a292c455f0f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:57.687421 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1c4f91ce-dd97-4cfb-b79e-2a292c455f0f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:57.702119 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1c4f91ce-dd97-4cfb-b79e-2a292c455f0f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:57.702119 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1c4f91ce-dd97-4cfb-b79e-2a292c455f0f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:57.702119 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1c4f91ce-dd97-4cfb-b79e-2a292c455f0f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1671 microversion: 2.20 time: 0.171228 Nov 24 16:13:57.702706 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 540/1059] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:57 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:57.830583 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-64fd5cae-fdbf-4e53-9248-9e5b240de16a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:57.831629 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-64fd5cae-fdbf-4e53-9248-9e5b240de16a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:57.841208 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64fd5cae-fdbf-4e53-9248-9e5b240de16a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:57.841664 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64fd5cae-fdbf-4e53-9248-9e5b240de16a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:57.842562 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64fd5cae-fdbf-4e53-9248-9e5b240de16a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:57.842998 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-64fd5cae-fdbf-4e53-9248-9e5b240de16a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:57.929407 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-64fd5cae-fdbf-4e53-9248-9e5b240de16a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action" status: 200 len: 38278 microversion: 2.1 time: 0.102525 Nov 24 16:13:57.935033 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 520/1060] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:13:57 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/action => generated 38278 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 16:13:57.940011 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8ef0e84d-2be0-4369-acf2-edafc33de484 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:57.940528 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8ef0e84d-2be0-4369-acf2-edafc33de484 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:57.946779 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8ef0e84d-2be0-4369-acf2-edafc33de484 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:57.947222 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8ef0e84d-2be0-4369-acf2-edafc33de484 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:57.947986 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8ef0e84d-2be0-4369-acf2-edafc33de484 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:57.948411 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8ef0e84d-2be0-4369-acf2-edafc33de484 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:57.975199 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8ef0e84d-2be0-4369-acf2-edafc33de484 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/ips" status: 200 len: 146 microversion: 2.1 time: 0.038710 Nov 24 16:13:57.975775 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 541/1061] 10.222.0.72 () {58 vars in 1247 bytes} [Wed Nov 24 16:13:57 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:13:58.719899 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c5768707-d8df-4fe8-a1a2-05cbbbfee80d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:58.720587 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c5768707-d8df-4fe8-a1a2-05cbbbfee80d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:58.727692 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5768707-d8df-4fe8-a1a2-05cbbbfee80d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:58.728146 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5768707-d8df-4fe8-a1a2-05cbbbfee80d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:58.728931 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5768707-d8df-4fe8-a1a2-05cbbbfee80d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:58.729400 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c5768707-d8df-4fe8-a1a2-05cbbbfee80d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:58.879565 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c5768707-d8df-4fe8-a1a2-05cbbbfee80d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:58.888001 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c5768707-d8df-4fe8-a1a2-05cbbbfee80d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:58.889540 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c5768707-d8df-4fe8-a1a2-05cbbbfee80d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:13:58.890752 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c5768707-d8df-4fe8-a1a2-05cbbbfee80d tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.175591 Nov 24 16:13:58.892002 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 521/1062] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:58 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:13:59.302060 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-543b6e83-9eba-4089-bf79-61d06b9a514f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c980808-a782-443f-8f09-9f7370279a18"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:13:59.303129 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-543b6e83-9eba-4089-bf79-61d06b9a514f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:59.309555 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-543b6e83-9eba-4089-bf79-61d06b9a514f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:59.310003 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-543b6e83-9eba-4089-bf79-61d06b9a514f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:59.310823 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-543b6e83-9eba-4089-bf79-61d06b9a514f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:59.311254 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-543b6e83-9eba-4089-bf79-61d06b9a514f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:59.602929 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-543b6e83-9eba-4089-bf79-61d06b9a514f tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303631 Nov 24 16:13:59.604738 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 542/1063] 10.222.0.72 () {60 vars in 1322 bytes} [Wed Nov 24 16:13:59 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:13:59.959316 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b8ab59ae-3abf-4e85-8b11-7cf3d03f8c55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:13:59.961352 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b8ab59ae-3abf-4e85-8b11-7cf3d03f8c55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:13:59.989635 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b8ab59ae-3abf-4e85-8b11-7cf3d03f8c55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:13:59.991389 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b8ab59ae-3abf-4e85-8b11-7cf3d03f8c55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:13:59.994656 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b8ab59ae-3abf-4e85-8b11-7cf3d03f8c55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:00.000024 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b8ab59ae-3abf-4e85-8b11-7cf3d03f8c55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:00.301994 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b8ab59ae-3abf-4e85-8b11-7cf3d03f8c55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:00.315403 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b8ab59ae-3abf-4e85-8b11-7cf3d03f8c55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:00.316228 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b8ab59ae-3abf-4e85-8b11-7cf3d03f8c55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:00.317674 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b8ab59ae-3abf-4e85-8b11-7cf3d03f8c55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.397966 Nov 24 16:14:00.318393 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 522/1064] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:13:59 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:01.337643 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3473db22-2d1d-4ccb-8f80-046bbddcd234 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:01.338268 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3473db22-2d1d-4ccb-8f80-046bbddcd234 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:01.345667 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3473db22-2d1d-4ccb-8f80-046bbddcd234 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:01.346055 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3473db22-2d1d-4ccb-8f80-046bbddcd234 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:01.346858 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3473db22-2d1d-4ccb-8f80-046bbddcd234 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:01.347535 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3473db22-2d1d-4ccb-8f80-046bbddcd234 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:01.485289 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3473db22-2d1d-4ccb-8f80-046bbddcd234 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:01.493614 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3473db22-2d1d-4ccb-8f80-046bbddcd234 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:01.495134 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3473db22-2d1d-4ccb-8f80-046bbddcd234 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:01.496322 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3473db22-2d1d-4ccb-8f80-046bbddcd234 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.163517 Nov 24 16:14:01.497166 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 543/1065] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:01 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:14:02.516248 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d6f5686e-c965-442c-a104-a2ad1eb484ea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:02.516837 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d6f5686e-c965-442c-a104-a2ad1eb484ea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:02.523476 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d6f5686e-c965-442c-a104-a2ad1eb484ea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:02.523920 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d6f5686e-c965-442c-a104-a2ad1eb484ea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:02.524736 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d6f5686e-c965-442c-a104-a2ad1eb484ea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:02.525247 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d6f5686e-c965-442c-a104-a2ad1eb484ea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:02.665710 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d6f5686e-c965-442c-a104-a2ad1eb484ea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:02.674915 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d6f5686e-c965-442c-a104-a2ad1eb484ea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:02.676406 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d6f5686e-c965-442c-a104-a2ad1eb484ea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:02.677592 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d6f5686e-c965-442c-a104-a2ad1eb484ea tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.165860 Nov 24 16:14:02.678155 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 523/1066] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:02 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:03.696849 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6676f11e-59b7-4c0b-8017-6ae016a6f4ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:03.697516 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6676f11e-59b7-4c0b-8017-6ae016a6f4ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:03.704313 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6676f11e-59b7-4c0b-8017-6ae016a6f4ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:03.704755 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6676f11e-59b7-4c0b-8017-6ae016a6f4ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:03.705604 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6676f11e-59b7-4c0b-8017-6ae016a6f4ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:03.706038 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6676f11e-59b7-4c0b-8017-6ae016a6f4ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:03.847479 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6676f11e-59b7-4c0b-8017-6ae016a6f4ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:03.864498 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6676f11e-59b7-4c0b-8017-6ae016a6f4ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:03.866247 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6676f11e-59b7-4c0b-8017-6ae016a6f4ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:03.867457 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6676f11e-59b7-4c0b-8017-6ae016a6f4ec tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.174500 Nov 24 16:14:03.868237 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 544/1067] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:03 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:04.902805 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-849b0c78-c304-4f9c-85e3-10cc30a24642 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:04.907790 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-849b0c78-c304-4f9c-85e3-10cc30a24642 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:04.922920 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-849b0c78-c304-4f9c-85e3-10cc30a24642 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:04.923465 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-849b0c78-c304-4f9c-85e3-10cc30a24642 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:04.924278 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-849b0c78-c304-4f9c-85e3-10cc30a24642 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:04.924721 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-849b0c78-c304-4f9c-85e3-10cc30a24642 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:05.090325 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-849b0c78-c304-4f9c-85e3-10cc30a24642 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:05.100446 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-849b0c78-c304-4f9c-85e3-10cc30a24642 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:05.101980 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-849b0c78-c304-4f9c-85e3-10cc30a24642 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:05.103145 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-849b0c78-c304-4f9c-85e3-10cc30a24642 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.219181 Nov 24 16:14:05.103909 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 524/1068] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:04 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:06.123977 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7c96f212-e377-4edf-824c-524fda4702fe tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:06.124747 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7c96f212-e377-4edf-824c-524fda4702fe tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:06.148163 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7c96f212-e377-4edf-824c-524fda4702fe tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:06.149061 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7c96f212-e377-4edf-824c-524fda4702fe tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:06.150750 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7c96f212-e377-4edf-824c-524fda4702fe tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:06.151661 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7c96f212-e377-4edf-824c-524fda4702fe tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:06.333880 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7c96f212-e377-4edf-824c-524fda4702fe tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:06.349562 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7c96f212-e377-4edf-824c-524fda4702fe tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:06.352594 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7c96f212-e377-4edf-824c-524fda4702fe tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:06.354333 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7c96f212-e377-4edf-824c-524fda4702fe tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.235600 Nov 24 16:14:06.355003 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 545/1069] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:06 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:07.383448 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-98a01f41-66ec-4ee3-ae1d-1ccfe3d8ceef tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:07.384034 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-98a01f41-66ec-4ee3-ae1d-1ccfe3d8ceef tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:07.392149 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-98a01f41-66ec-4ee3-ae1d-1ccfe3d8ceef tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:07.392691 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-98a01f41-66ec-4ee3-ae1d-1ccfe3d8ceef tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:07.393686 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-98a01f41-66ec-4ee3-ae1d-1ccfe3d8ceef tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:07.394189 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-98a01f41-66ec-4ee3-ae1d-1ccfe3d8ceef tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:07.564974 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-98a01f41-66ec-4ee3-ae1d-1ccfe3d8ceef tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:07.574011 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-98a01f41-66ec-4ee3-ae1d-1ccfe3d8ceef tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:07.575581 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-98a01f41-66ec-4ee3-ae1d-1ccfe3d8ceef tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:07.576914 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-98a01f41-66ec-4ee3-ae1d-1ccfe3d8ceef tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.205299 Nov 24 16:14:07.577522 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 525/1070] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:07 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:08.600012 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-40e56042-51e8-48b8-a837-e1904b80a4c8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:08.600658 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-40e56042-51e8-48b8-a837-e1904b80a4c8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:08.608024 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-40e56042-51e8-48b8-a837-e1904b80a4c8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:08.608492 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-40e56042-51e8-48b8-a837-e1904b80a4c8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:08.609984 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-40e56042-51e8-48b8-a837-e1904b80a4c8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:08.610450 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-40e56042-51e8-48b8-a837-e1904b80a4c8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:08.786926 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-40e56042-51e8-48b8-a837-e1904b80a4c8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:08.795575 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-40e56042-51e8-48b8-a837-e1904b80a4c8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:08.797671 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-40e56042-51e8-48b8-a837-e1904b80a4c8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:08.798879 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-40e56042-51e8-48b8-a837-e1904b80a4c8 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.203583 Nov 24 16:14:08.799441 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 546/1071] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:08 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:09.818733 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d1efcf9b-6c75-4dc8-bf70-693876ecbc3f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:09.819297 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d1efcf9b-6c75-4dc8-bf70-693876ecbc3f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:09.830423 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1efcf9b-6c75-4dc8-bf70-693876ecbc3f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:09.830887 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1efcf9b-6c75-4dc8-bf70-693876ecbc3f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:09.831801 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1efcf9b-6c75-4dc8-bf70-693876ecbc3f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:09.832242 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d1efcf9b-6c75-4dc8-bf70-693876ecbc3f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:09.998681 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d1efcf9b-6c75-4dc8-bf70-693876ecbc3f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:10.011111 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d1efcf9b-6c75-4dc8-bf70-693876ecbc3f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:10.014264 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d1efcf9b-6c75-4dc8-bf70-693876ecbc3f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:10.017488 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d1efcf9b-6c75-4dc8-bf70-693876ecbc3f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.202449 Nov 24 16:14:10.018638 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 526/1072] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:09 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:11.038618 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7d9d2cff-be00-4b5e-986b-e6d915213de1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:11.039280 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7d9d2cff-be00-4b5e-986b-e6d915213de1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:11.046295 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7d9d2cff-be00-4b5e-986b-e6d915213de1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:11.047957 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7d9d2cff-be00-4b5e-986b-e6d915213de1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:11.048773 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7d9d2cff-be00-4b5e-986b-e6d915213de1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:11.049303 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7d9d2cff-be00-4b5e-986b-e6d915213de1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:11.197893 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7d9d2cff-be00-4b5e-986b-e6d915213de1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:11.206478 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7d9d2cff-be00-4b5e-986b-e6d915213de1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:11.207985 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7d9d2cff-be00-4b5e-986b-e6d915213de1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:11.209183 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7d9d2cff-be00-4b5e-986b-e6d915213de1 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.174412 Nov 24 16:14:11.209962 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 547/1073] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:11 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:12.227128 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b74feb31-8c09-4f12-95ea-c268fac927c4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:12.227768 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b74feb31-8c09-4f12-95ea-c268fac927c4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:12.236262 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b74feb31-8c09-4f12-95ea-c268fac927c4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:12.236719 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b74feb31-8c09-4f12-95ea-c268fac927c4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:12.237541 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b74feb31-8c09-4f12-95ea-c268fac927c4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:12.237981 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b74feb31-8c09-4f12-95ea-c268fac927c4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:12.378911 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b74feb31-8c09-4f12-95ea-c268fac927c4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:12.387924 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b74feb31-8c09-4f12-95ea-c268fac927c4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:12.389475 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b74feb31-8c09-4f12-95ea-c268fac927c4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:12.390639 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b74feb31-8c09-4f12-95ea-c268fac927c4 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.167272 Nov 24 16:14:12.391332 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 527/1074] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:12 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:13.410621 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-dec841cc-8cec-4bef-974d-cb7ad4a73974 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:13.411244 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-dec841cc-8cec-4bef-974d-cb7ad4a73974 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:13.418272 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dec841cc-8cec-4bef-974d-cb7ad4a73974 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:13.418821 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dec841cc-8cec-4bef-974d-cb7ad4a73974 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:13.419608 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dec841cc-8cec-4bef-974d-cb7ad4a73974 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:13.420093 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dec841cc-8cec-4bef-974d-cb7ad4a73974 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:13.570641 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-dec841cc-8cec-4bef-974d-cb7ad4a73974 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:13.579895 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-dec841cc-8cec-4bef-974d-cb7ad4a73974 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:13.581467 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-dec841cc-8cec-4bef-974d-cb7ad4a73974 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:13.582668 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-dec841cc-8cec-4bef-974d-cb7ad4a73974 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.175954 Nov 24 16:14:13.583246 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 548/1075] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:13 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:14:14.603638 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2fff2f0a-93e7-476b-b180-e7b82845924f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:14.604371 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-2fff2f0a-93e7-476b-b180-e7b82845924f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:14.612849 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2fff2f0a-93e7-476b-b180-e7b82845924f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:14.613399 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2fff2f0a-93e7-476b-b180-e7b82845924f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:14.614303 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2fff2f0a-93e7-476b-b180-e7b82845924f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:14.614794 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-2fff2f0a-93e7-476b-b180-e7b82845924f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:14.750388 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2fff2f0a-93e7-476b-b180-e7b82845924f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:14.758635 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2fff2f0a-93e7-476b-b180-e7b82845924f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:14.760132 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-2fff2f0a-93e7-476b-b180-e7b82845924f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:14.761322 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2fff2f0a-93e7-476b-b180-e7b82845924f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.162371 Nov 24 16:14:14.761898 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 528/1076] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:14 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:15.796292 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-aa630110-220b-4e92-982d-fbc72defa54e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:15.799098 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-aa630110-220b-4e92-982d-fbc72defa54e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:15.825484 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aa630110-220b-4e92-982d-fbc72defa54e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:15.826288 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aa630110-220b-4e92-982d-fbc72defa54e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:15.827675 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aa630110-220b-4e92-982d-fbc72defa54e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:15.828809 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aa630110-220b-4e92-982d-fbc72defa54e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:16.032272 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-aa630110-220b-4e92-982d-fbc72defa54e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:16.040511 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-aa630110-220b-4e92-982d-fbc72defa54e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:16.042111 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-aa630110-220b-4e92-982d-fbc72defa54e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:16.043292 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-aa630110-220b-4e92-982d-fbc72defa54e tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.263817 Nov 24 16:14:16.043854 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 549/1077] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:15 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:17.062144 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a52bbc97-cec9-4e13-91ea-f82c5f5f0adc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:17.062928 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a52bbc97-cec9-4e13-91ea-f82c5f5f0adc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:17.069540 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a52bbc97-cec9-4e13-91ea-f82c5f5f0adc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:17.069991 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a52bbc97-cec9-4e13-91ea-f82c5f5f0adc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:17.070782 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a52bbc97-cec9-4e13-91ea-f82c5f5f0adc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:17.071221 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a52bbc97-cec9-4e13-91ea-f82c5f5f0adc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:17.206815 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a52bbc97-cec9-4e13-91ea-f82c5f5f0adc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:17.215166 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a52bbc97-cec9-4e13-91ea-f82c5f5f0adc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:17.216641 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a52bbc97-cec9-4e13-91ea-f82c5f5f0adc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:17.217816 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a52bbc97-cec9-4e13-91ea-f82c5f5f0adc tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.159403 Nov 24 16:14:17.218382 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 529/1078] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:17 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:18.239166 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7e214f5b-24e0-49b1-8cac-995438a0ef55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:18.239780 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7e214f5b-24e0-49b1-8cac-995438a0ef55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:18.246182 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7e214f5b-24e0-49b1-8cac-995438a0ef55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:18.246888 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7e214f5b-24e0-49b1-8cac-995438a0ef55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:18.247663 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7e214f5b-24e0-49b1-8cac-995438a0ef55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:18.248121 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7e214f5b-24e0-49b1-8cac-995438a0ef55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:18.392048 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7e214f5b-24e0-49b1-8cac-995438a0ef55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:18.400269 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7e214f5b-24e0-49b1-8cac-995438a0ef55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:18.401859 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7e214f5b-24e0-49b1-8cac-995438a0ef55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:18.403023 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7e214f5b-24e0-49b1-8cac-995438a0ef55 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.168075 Nov 24 16:14:18.403579 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 550/1079] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:18 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:19.415773 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-8ece13d2-f72c-4bfb-91b1-e9c0ab6537e6 req-9d1409c8-eaf9-40e1-8076-1c29b89448ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-plugged", "status": "completed", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:14:19.418256 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:14:19.418256 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:14:19.426385 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-00ada01f-9043-45b3-a160-f58856607a00 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:19.427970 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-8ece13d2-f72c-4bfb-91b1-e9c0ab6537e6 req-9d1409c8-eaf9-40e1-8076-1c29b89448ba service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:19.428094 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-00ada01f-9043-45b3-a160-f58856607a00 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:19.428431 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-8ece13d2-f72c-4bfb-91b1-e9c0ab6537e6 req-9d1409c8-eaf9-40e1-8076-1c29b89448ba service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:19.438408 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-00ada01f-9043-45b3-a160-f58856607a00 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:19.439444 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-00ada01f-9043-45b3-a160-f58856607a00 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:19.440441 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-00ada01f-9043-45b3-a160-f58856607a00 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:19.441094 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-00ada01f-9043-45b3-a160-f58856607a00 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:19.442754 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-8ece13d2-f72c-4bfb-91b1-e9c0ab6537e6 req-9d1409c8-eaf9-40e1-8076-1c29b89448ba service nova] Creating event network-vif-plugged:4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 for instance b62212ea-7c11-4095-adf5-a78b04d67de0 on hv-cinder-81899 Nov 24 16:14:19.460317 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-8ece13d2-f72c-4bfb-91b1-e9c0ab6537e6 req-9d1409c8-eaf9-40e1-8076-1c29b89448ba service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048313 Nov 24 16:14:19.461134 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 530/1080] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:14:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:14:19.622390 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-00ada01f-9043-45b3-a160-f58856607a00 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:19.631767 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-00ada01f-9043-45b3-a160-f58856607a00 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:19.633302 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-00ada01f-9043-45b3-a160-f58856607a00 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:19.634542 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-00ada01f-9043-45b3-a160-f58856607a00 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.216819 Nov 24 16:14:19.645663 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 551/1081] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:19 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:20.656604 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-52e0eb81-00a0-489c-8d07-74f5c7c133bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:20.657347 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-52e0eb81-00a0-489c-8d07-74f5c7c133bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:20.663307 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-52e0eb81-00a0-489c-8d07-74f5c7c133bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:20.663761 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-52e0eb81-00a0-489c-8d07-74f5c7c133bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:20.664546 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-52e0eb81-00a0-489c-8d07-74f5c7c133bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:20.664986 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-52e0eb81-00a0-489c-8d07-74f5c7c133bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:20.809187 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-52e0eb81-00a0-489c-8d07-74f5c7c133bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:20.817960 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-52e0eb81-00a0-489c-8d07-74f5c7c133bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:20.819739 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-52e0eb81-00a0-489c-8d07-74f5c7c133bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:20.820603 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-52e0eb81-00a0-489c-8d07-74f5c7c133bf tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.169330 Nov 24 16:14:20.821192 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 531/1082] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:20 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:20.939315 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-af2d897f-90ef-4401-b0af-289c2f890845 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:20.940333 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-af2d897f-90ef-4401-b0af-289c2f890845 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:20.947245 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-af2d897f-90ef-4401-b0af-289c2f890845 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:20.947686 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-af2d897f-90ef-4401-b0af-289c2f890845 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:20.948464 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-af2d897f-90ef-4401-b0af-289c2f890845 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:20.948892 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-af2d897f-90ef-4401-b0af-289c2f890845 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:20.979840 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-af2d897f-90ef-4401-b0af-289c2f890845 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044519 Nov 24 16:14:20.980408 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 552/1083] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:14:20 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:14:20.990337 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-9375725c-a295-4678-93b5-3709d63813ff tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:20.990827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-9375725c-a295-4678-93b5-3709d63813ff tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:20.997138 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9375725c-a295-4678-93b5-3709d63813ff tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:20.997596 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9375725c-a295-4678-93b5-3709d63813ff tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:20.998391 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9375725c-a295-4678-93b5-3709d63813ff tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:20.998828 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-9375725c-a295-4678-93b5-3709d63813ff tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:21.028174 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-9375725c-a295-4678-93b5-3709d63813ff tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments/0c980808-a782-443f-8f09-9f7370279a18" status: 200 len: 194 microversion: 2.1 time: 0.041553 Nov 24 16:14:21.028675 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 532/1084] 10.222.0.72 () {58 vars in 1412 bytes} [Wed Nov 24 16:14:20 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments/0c980808-a782-443f-8f09-9f7370279a18 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:14:21.839866 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8e9c0f70-155a-4439-badb-e43ba6184802 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:21.840528 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8e9c0f70-155a-4439-badb-e43ba6184802 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:21.847494 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8e9c0f70-155a-4439-badb-e43ba6184802 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:21.847969 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8e9c0f70-155a-4439-badb-e43ba6184802 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:21.848814 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8e9c0f70-155a-4439-badb-e43ba6184802 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:21.849281 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8e9c0f70-155a-4439-badb-e43ba6184802 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:22.008748 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8e9c0f70-155a-4439-badb-e43ba6184802 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:22.018064 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8e9c0f70-155a-4439-badb-e43ba6184802 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:22.019469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8e9c0f70-155a-4439-badb-e43ba6184802 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:22.020661 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8e9c0f70-155a-4439-badb-e43ba6184802 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1729 microversion: 2.20 time: 0.184708 Nov 24 16:14:22.021290 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 553/1085] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:21 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:22.370708 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cae19ce4-b082-48fa-b19e-8ec75cabe6e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2359143c-6f2e-412b-8203-e8b02ebe63b5"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:14:22.372242 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cae19ce4-b082-48fa-b19e-8ec75cabe6e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:22.379607 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cae19ce4-b082-48fa-b19e-8ec75cabe6e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:22.380057 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cae19ce4-b082-48fa-b19e-8ec75cabe6e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:22.380851 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cae19ce4-b082-48fa-b19e-8ec75cabe6e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:22.381316 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cae19ce4-b082-48fa-b19e-8ec75cabe6e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:22.626155 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cae19ce4-b082-48fa-b19e-8ec75cabe6e4 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259015 Nov 24 16:14:22.626817 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 533/1086] 10.222.0.72 () {60 vars in 1322 bytes} [Wed Nov 24 16:14:22 2021] POST /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:14:23.040371 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-df88119b-07a3-4430-a3ef-2c04fbaaac7a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:23.041492 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-df88119b-07a3-4430-a3ef-2c04fbaaac7a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:23.050993 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-df88119b-07a3-4430-a3ef-2c04fbaaac7a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:23.051528 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-df88119b-07a3-4430-a3ef-2c04fbaaac7a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:23.052519 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-df88119b-07a3-4430-a3ef-2c04fbaaac7a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:23.053098 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-df88119b-07a3-4430-a3ef-2c04fbaaac7a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:23.192339 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-df88119b-07a3-4430-a3ef-2c04fbaaac7a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:23.200305 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-df88119b-07a3-4430-a3ef-2c04fbaaac7a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:23.201848 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-df88119b-07a3-4430-a3ef-2c04fbaaac7a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:23.203071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-df88119b-07a3-4430-a3ef-2c04fbaaac7a tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1716 microversion: 2.20 time: 0.168067 Nov 24 16:14:23.203635 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 554/1087] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:14:23 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1716 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:14:30.114076 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e4a76e16-6a6e-4062-bb89-5e58a80a106e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:30.115107 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e4a76e16-6a6e-4062-bb89-5e58a80a106e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:30.121956 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e4a76e16-6a6e-4062-bb89-5e58a80a106e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:30.122414 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e4a76e16-6a6e-4062-bb89-5e58a80a106e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:30.123283 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e4a76e16-6a6e-4062-bb89-5e58a80a106e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:30.123742 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e4a76e16-6a6e-4062-bb89-5e58a80a106e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:30.158680 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e4a76e16-6a6e-4062-bb89-5e58a80a106e tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050136 Nov 24 16:14:30.159282 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 534/1088] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:14:30 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:14:30.417131 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-684b7f44-a8c5-4c11-81a5-724ed4484237 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:30.417730 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-684b7f44-a8c5-4c11-81a5-724ed4484237 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:30.424808 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-684b7f44-a8c5-4c11-81a5-724ed4484237 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:30.425297 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-684b7f44-a8c5-4c11-81a5-724ed4484237 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:30.426100 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-684b7f44-a8c5-4c11-81a5-724ed4484237 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:30.426540 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-684b7f44-a8c5-4c11-81a5-724ed4484237 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:30.458589 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-684b7f44-a8c5-4c11-81a5-724ed4484237 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments/0c980808-a782-443f-8f09-9f7370279a18" status: 200 len: 194 microversion: 2.1 time: 0.045376 Nov 24 16:14:30.459208 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 555/1089] 10.222.0.72 () {58 vars in 1412 bytes} [Wed Nov 24 16:14:30 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments/0c980808-a782-443f-8f09-9f7370279a18 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:14:30.472866 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-51489da3-e21c-48ad-97c5-0b9064f1b41a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:30.473543 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-51489da3-e21c-48ad-97c5-0b9064f1b41a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:30.484715 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-51489da3-e21c-48ad-97c5-0b9064f1b41a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:30.485572 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-51489da3-e21c-48ad-97c5-0b9064f1b41a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:30.487057 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-51489da3-e21c-48ad-97c5-0b9064f1b41a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:30.487869 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-51489da3-e21c-48ad-97c5-0b9064f1b41a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:30.573534 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-51489da3-e21c-48ad-97c5-0b9064f1b41a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lazy-loading 'services' on Instance uuid c8582c22-790a-4760-84f8-78b7929748d3 {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:14:30.652408 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-51489da3-e21c-48ad-97c5-0b9064f1b41a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments/0c980808-a782-443f-8f09-9f7370279a18" status: 202 len: 0 microversion: 2.1 time: 0.185438 Nov 24 16:14:30.653065 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 535/1090] 10.222.0.72 () {58 vars in 1415 bytes} [Wed Nov 24 16:14:30 2021] DELETE /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments/0c980808-a782-443f-8f09-9f7370279a18 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:14:31.793381 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4bfa8b57-8f09-4539-9a5e-e4b3fc95420c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:31.793987 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4bfa8b57-8f09-4539-9a5e-e4b3fc95420c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:31.801448 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4bfa8b57-8f09-4539-9a5e-e4b3fc95420c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:31.801892 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4bfa8b57-8f09-4539-9a5e-e4b3fc95420c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:31.802697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4bfa8b57-8f09-4539-9a5e-e4b3fc95420c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:31.803134 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4bfa8b57-8f09-4539-9a5e-e4b3fc95420c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:31.850870 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4bfa8b57-8f09-4539-9a5e-e4b3fc95420c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments/2359143c-6f2e-412b-8203-e8b02ebe63b5" status: 200 len: 194 microversion: 2.1 time: 0.061408 Nov 24 16:14:31.851495 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 556/1091] 10.222.0.72 () {58 vars in 1412 bytes} [Wed Nov 24 16:14:31 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments/2359143c-6f2e-412b-8203-e8b02ebe63b5 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:14:31.864576 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-34e772ab-a7dc-4996-b482-700271333d81 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:31.865221 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-34e772ab-a7dc-4996-b482-700271333d81 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:31.871772 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-34e772ab-a7dc-4996-b482-700271333d81 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:31.872238 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-34e772ab-a7dc-4996-b482-700271333d81 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:31.873048 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-34e772ab-a7dc-4996-b482-700271333d81 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:31.873494 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-34e772ab-a7dc-4996-b482-700271333d81 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:31.962956 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-34e772ab-a7dc-4996-b482-700271333d81 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lazy-loading 'services' on Instance uuid c8582c22-790a-4760-84f8-78b7929748d3 {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:14:32.052722 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-34e772ab-a7dc-4996-b482-700271333d81 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments/2359143c-6f2e-412b-8203-e8b02ebe63b5" status: 202 len: 0 microversion: 2.1 time: 0.194276 Nov 24 16:14:32.053395 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 536/1092] 10.222.0.72 () {58 vars in 1415 bytes} [Wed Nov 24 16:14:31 2021] DELETE /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments/2359143c-6f2e-412b-8203-e8b02ebe63b5 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 16:14:33.232318 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-241ad64d-dfab-4a3f-b8c4-030958f88fa2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:33.233946 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-241ad64d-dfab-4a3f-b8c4-030958f88fa2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:33.245675 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-241ad64d-dfab-4a3f-b8c4-030958f88fa2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:33.246761 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-241ad64d-dfab-4a3f-b8c4-030958f88fa2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:33.247832 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-241ad64d-dfab-4a3f-b8c4-030958f88fa2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:33.248642 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-241ad64d-dfab-4a3f-b8c4-030958f88fa2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:33.305515 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-241ad64d-dfab-4a3f-b8c4-030958f88fa2 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078184 Nov 24 16:14:33.306390 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 557/1093] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:14:33 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:14:33.431800 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-04c85429-565f-41e5-b42a-e7ece2ef318a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:33.432837 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-04c85429-565f-41e5-b42a-e7ece2ef318a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:33.440099 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-04c85429-565f-41e5-b42a-e7ece2ef318a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:33.440673 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-04c85429-565f-41e5-b42a-e7ece2ef318a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:33.441355 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-04c85429-565f-41e5-b42a-e7ece2ef318a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:33.441785 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-04c85429-565f-41e5-b42a-e7ece2ef318a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:33.472329 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-04c85429-565f-41e5-b42a-e7ece2ef318a tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045035 Nov 24 16:14:33.472912 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 537/1094] 10.222.0.72 () {58 vars in 1301 bytes} [Wed Nov 24 16:14:33 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 16:14:33.533541 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:33.534174 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:33.540456 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:33.540893 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:33.541705 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:33.542134 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:33.577625 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Going to try to terminate instance {{(pid=116303) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:14:33.672068 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-764b25c0-72b9-4311-b1c9-b1ccdca85d30 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 204 len: 0 microversion: 2.1 time: 0.140984 Nov 24 16:14:33.673215 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 558/1095] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:14:33 2021] DELETE /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:14:33.682823 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-96043303-f205-4381-a010-7ea5a9c7e4b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:33.683431 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-96043303-f205-4381-a010-7ea5a9c7e4b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:33.690898 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96043303-f205-4381-a010-7ea5a9c7e4b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:33.691348 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96043303-f205-4381-a010-7ea5a9c7e4b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:33.692184 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96043303-f205-4381-a010-7ea5a9c7e4b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:33.692624 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-96043303-f205-4381-a010-7ea5a9c7e4b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:33.856075 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-96043303-f205-4381-a010-7ea5a9c7e4b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:33.864685 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-96043303-f205-4381-a010-7ea5a9c7e4b1 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1675 microversion: 2.1 time: 0.185640 Nov 24 16:14:33.865320 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 538/1096] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:14:33 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:14:34.884006 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-742d44ec-1e23-468e-bfd1-f82d73b417ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:34.884703 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-742d44ec-1e23-468e-bfd1-f82d73b417ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:34.891421 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-742d44ec-1e23-468e-bfd1-f82d73b417ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:34.892063 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-742d44ec-1e23-468e-bfd1-f82d73b417ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:34.893300 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-742d44ec-1e23-468e-bfd1-f82d73b417ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:34.894272 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-742d44ec-1e23-468e-bfd1-f82d73b417ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:35.053830 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-742d44ec-1e23-468e-bfd1-f82d73b417ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:35.061670 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-742d44ec-1e23-468e-bfd1-f82d73b417ac tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1675 microversion: 2.1 time: 0.181779 Nov 24 16:14:35.062468 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 559/1097] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:14:34 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:14:36.084405 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-82feeaed-7d83-4c8a-95ce-c26d53bc2536 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:36.085710 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-82feeaed-7d83-4c8a-95ce-c26d53bc2536 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:36.098717 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-82feeaed-7d83-4c8a-95ce-c26d53bc2536 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:36.099521 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-82feeaed-7d83-4c8a-95ce-c26d53bc2536 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:36.100563 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-82feeaed-7d83-4c8a-95ce-c26d53bc2536 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:36.101384 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-82feeaed-7d83-4c8a-95ce-c26d53bc2536 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:36.378332 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-82feeaed-7d83-4c8a-95ce-c26d53bc2536 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:36.387392 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-82feeaed-7d83-4c8a-95ce-c26d53bc2536 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1675 microversion: 2.1 time: 0.310239 Nov 24 16:14:36.388222 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 539/1098] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:14:36 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1675 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:14:36.986103 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-6b9e81d5-c47b-4e63-ad6e-f3745a6f74f9 req-4e0dfed5-7baa-4fd9-a13c-ac0976e22d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8582c22-790a-4760-84f8-78b7929748d3", "name": "network-vif-deleted", "tag": "e95db78b-d6c2-46b5-b57f-c37954356d5c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:14:36.994407 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:14:36.994407 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:14:37.020548 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-6b9e81d5-c47b-4e63-ad6e-f3745a6f74f9 req-4e0dfed5-7baa-4fd9-a13c-ac0976e22d8a service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:37.021925 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-6b9e81d5-c47b-4e63-ad6e-f3745a6f74f9 req-4e0dfed5-7baa-4fd9-a13c-ac0976e22d8a service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:37.058623 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-6b9e81d5-c47b-4e63-ad6e-f3745a6f74f9 req-4e0dfed5-7baa-4fd9-a13c-ac0976e22d8a service nova] Creating event network-vif-deleted:e95db78b-d6c2-46b5-b57f-c37954356d5c for instance c8582c22-790a-4760-84f8-78b7929748d3 on hv-cinder-81899 Nov 24 16:14:37.070450 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-6b9e81d5-c47b-4e63-ad6e-f3745a6f74f9 req-4e0dfed5-7baa-4fd9-a13c-ac0976e22d8a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091136 Nov 24 16:14:37.072008 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 560/1099] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:14:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:14:37.408377 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1d47be6e-a62d-45e8-85a5-dc339f56d7b6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:37.420018 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1d47be6e-a62d-45e8-85a5-dc339f56d7b6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:37.435514 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1d47be6e-a62d-45e8-85a5-dc339f56d7b6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:37.437741 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1d47be6e-a62d-45e8-85a5-dc339f56d7b6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:37.439719 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1d47be6e-a62d-45e8-85a5-dc339f56d7b6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:37.440862 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1d47be6e-a62d-45e8-85a5-dc339f56d7b6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:37.502702 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1d47be6e-a62d-45e8-85a5-dc339f56d7b6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:37.503219 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1d47be6e-a62d-45e8-85a5-dc339f56d7b6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:37.503806 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-1d47be6e-a62d-45e8-85a5-dc339f56d7b6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lazy-loading 'fault' on Instance uuid c8582c22-790a-4760-84f8-78b7929748d3 {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:14:37.569838 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1d47be6e-a62d-45e8-85a5-dc339f56d7b6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d57401cbd6048c8b02c727520df44e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c341b845ae6468b847beba4eee796dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:14:37.579608 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1d47be6e-a62d-45e8-85a5-dc339f56d7b6 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 200 len: 1328 microversion: 2.1 time: 0.177045 Nov 24 16:14:37.580610 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 540/1100] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:14:37 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 1328 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:14:38.606219 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-971bc3b5-274e-4c2f-9270-9c19e37be286 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:38.606917 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-971bc3b5-274e-4c2f-9270-9c19e37be286 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:38.614479 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-971bc3b5-274e-4c2f-9270-9c19e37be286 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:38.614931 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-971bc3b5-274e-4c2f-9270-9c19e37be286 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:38.615732 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-971bc3b5-274e-4c2f-9270-9c19e37be286 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:38.616171 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-971bc3b5-274e-4c2f-9270-9c19e37be286 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:38.630616 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-971bc3b5-274e-4c2f-9270-9c19e37be286 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] HTTP exception thrown: Instance c8582c22-790a-4760-84f8-78b7929748d3 could not be found. Nov 24 16:14:38.631217 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-971bc3b5-274e-4c2f-9270-9c19e37be286 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Returning 404 to user: Instance c8582c22-790a-4760-84f8-78b7929748d3 could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:14:38.632057 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-971bc3b5-274e-4c2f-9270-9c19e37be286 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 404 len: 111 microversion: 2.1 time: 0.030023 Nov 24 16:14:38.632617 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 561/1101] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:14:38 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:14:38.641466 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-68f6c335-710d-46af-b8ac-29ce4ebac9a3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '.version_select at 0x7f361a8cdc10>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:38.661608 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-68f6c335-710d-46af-b8ac-29ce4ebac9a3 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900410206" status: 202 len: 0 microversion: 2.1 time: 0.024011 Nov 24 16:14:38.662535 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 541/1102] 10.222.0.72 () {58 vars in 1220 bytes} [Wed Nov 24 16:14:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900410206 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:14:41.775253 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-036db179-6735-45fc-9d05-2ca9af4d13e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:41.775906 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-036db179-6735-45fc-9d05-2ca9af4d13e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:41.782974 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-036db179-6735-45fc-9d05-2ca9af4d13e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:41.783414 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-036db179-6735-45fc-9d05-2ca9af4d13e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:41.784208 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-036db179-6735-45fc-9d05-2ca9af4d13e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:41.784634 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-036db179-6735-45fc-9d05-2ca9af4d13e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:41.802401 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-036db179-6735-45fc-9d05-2ca9af4d13e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] HTTP exception thrown: Instance c8582c22-790a-4760-84f8-78b7929748d3 could not be found. Nov 24 16:14:41.803009 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-036db179-6735-45fc-9d05-2ca9af4d13e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Returning 404 to user: Instance c8582c22-790a-4760-84f8-78b7929748d3 could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:14:41.803844 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-036db179-6735-45fc-9d05-2ca9af4d13e5 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 404 len: 111 microversion: 2.1 time: 0.032340 Nov 24 16:14:41.804397 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 562/1103] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:14:41 2021] DELETE /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 16:14:41.825424 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7260d576-314b-4039-a172-283a6304ed0c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:41.826511 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7260d576-314b-4039-a172-283a6304ed0c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: c8582c22-790a-4760-84f8-78b7929748d3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:41.836645 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7260d576-314b-4039-a172-283a6304ed0c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:41.837119 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7260d576-314b-4039-a172-283a6304ed0c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:41.837941 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7260d576-314b-4039-a172-283a6304ed0c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:41.838386 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7260d576-314b-4039-a172-283a6304ed0c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:41.852818 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-7260d576-314b-4039-a172-283a6304ed0c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] HTTP exception thrown: Instance c8582c22-790a-4760-84f8-78b7929748d3 could not be found. Nov 24 16:14:41.853457 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7260d576-314b-4039-a172-283a6304ed0c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Returning 404 to user: Instance c8582c22-790a-4760-84f8-78b7929748d3 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:14:41.854311 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7260d576-314b-4039-a172-283a6304ed0c tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3" status: 404 len: 111 microversion: 2.1 time: 0.036823 Nov 24 16:14:41.854881 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 542/1104] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:14:41 2021] GET /compute/v2.1/servers/c8582c22-790a-4760-84f8-78b7929748d3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:14:43.011069 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0389a3a6-8386-4aa9-ace7-a78778bc6dec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:43.011757 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0389a3a6-8386-4aa9-ace7-a78778bc6dec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:43.018021 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0389a3a6-8386-4aa9-ace7-a78778bc6dec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:43.018470 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0389a3a6-8386-4aa9-ace7-a78778bc6dec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:43.019274 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0389a3a6-8386-4aa9-ace7-a78778bc6dec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:43.019710 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0389a3a6-8386-4aa9-ace7-a78778bc6dec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:43.035044 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-0389a3a6-8386-4aa9-ace7-a78778bc6dec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] HTTP exception thrown: Instance 80f67d55-afc9-4ce8-a9c5-8256298c4b7e could not be found. Nov 24 16:14:43.035637 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0389a3a6-8386-4aa9-ace7-a78778bc6dec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Returning 404 to user: Instance 80f67d55-afc9-4ce8-a9c5-8256298c4b7e could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:14:43.036469 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0389a3a6-8386-4aa9-ace7-a78778bc6dec tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "DELETE /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 404 len: 111 microversion: 2.1 time: 0.029393 Nov 24 16:14:43.037034 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 563/1105] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:14:43 2021] DELETE /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:14:43.045199 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-21224170-cb72-4409-a146-f57233488b79 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:43.046453 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-21224170-cb72-4409-a146-f57233488b79 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] [instance: 80f67d55-afc9-4ce8-a9c5-8256298c4b7e] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:14:43.052966 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-21224170-cb72-4409-a146-f57233488b79 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:43.053446 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-21224170-cb72-4409-a146-f57233488b79 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:43.054247 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-21224170-cb72-4409-a146-f57233488b79 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:14:43.054682 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-21224170-cb72-4409-a146-f57233488b79 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:14:43.070077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-21224170-cb72-4409-a146-f57233488b79 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] HTTP exception thrown: Instance 80f67d55-afc9-4ce8-a9c5-8256298c4b7e could not be found. Nov 24 16:14:43.070680 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-21224170-cb72-4409-a146-f57233488b79 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] Returning 404 to user: Instance 80f67d55-afc9-4ce8-a9c5-8256298c4b7e could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:14:43.071526 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-21224170-cb72-4409-a146-f57233488b79 tempest-AttachVolumeTestJSON-383174196 tempest-AttachVolumeTestJSON-383174196-project] 10.222.0.72 "GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e" status: 404 len: 111 microversion: 2.1 time: 0.030226 Nov 24 16:14:43.072091 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 543/1106] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:14:43 2021] GET /compute/v2.1/servers/80f67d55-afc9-4ce8-a9c5-8256298c4b7e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:14:49.398883 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-415b1b40-2c01-4fa5-966c-6dd8a21a6dfa tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] Calling method '.version_select at 0x7f361a966f70>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:49.449171 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-415b1b40-2c01-4fa5-966c-6dd8a21a6dfa tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/0b3b0a5f-5f5b-48d0-9465-60f9ee1dbd1e" status: 200 len: 350 microversion: 2.1 time: 0.053943 Nov 24 16:14:49.450069 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 564/1107] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:14:49 2021] GET /compute/v2.1/os-volumes/0b3b0a5f-5f5b-48d0-9465-60f9ee1dbd1e => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:14:50.775034 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-2441e32f-5573-4ecf-a4d8-238533d437a2 tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] Calling method '.version_select at 0x7f361a8fcaf0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:50.823481 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-2441e32f-5573-4ecf-a4d8-238533d437a2 tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/474d7ded-b5d8-43c9-bc33-ff5fe7cc45ee" status: 200 len: 349 microversion: 2.1 time: 0.052220 Nov 24 16:14:50.824163 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 544/1108] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:14:50 2021] GET /compute/v2.1/os-volumes/474d7ded-b5d8-43c9-bc33-ff5fe7cc45ee => generated 349 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:14:52.168619 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c197c8a8-298e-4b12-9af2-681993664c81 tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] Calling method '.version_select at 0x7f361a8cf550>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:52.228270 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c197c8a8-298e-4b12-9af2-681993664c81 tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/17449853-cb6f-44c8-85c5-563847ec31cd" status: 200 len: 351 microversion: 2.1 time: 0.063768 Nov 24 16:14:52.228834 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 565/1109] 10.222.0.72 () {58 vars in 1244 bytes} [Wed Nov 24 16:14:52 2021] GET /compute/v2.1/os-volumes/17449853-cb6f-44c8-85c5-563847ec31cd => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:14:52.240646 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-de200b06-55e1-4e66-b2f7-7e4fe0dbf6fd tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] Calling method '.version_select at 0x7f361a8cd940>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:52.322845 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-de200b06-55e1-4e66-b2f7-7e4fe0dbf6fd tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.086257 Nov 24 16:14:52.323424 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 545/1110] 10.222.0.72 () {58 vars in 1133 bytes} [Wed Nov 24 16:14:52 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:14:52.339076 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0b646d80-902d-4ecf-b4d6-0358e9bed114 tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] Calling method '.version_select at 0x7f361a8854c0>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:52.433922 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0b646d80-902d-4ecf-b4d6-0358e9bed114 tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.100826 Nov 24 16:14:52.434495 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 566/1111] 10.222.0.72 () {58 vars in 1148 bytes} [Wed Nov 24 16:14:52 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:14:52.446427 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b08e074f-d756-4e98-a8ae-4c9b6d655215 tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] Calling method '.version_select at 0x7f361a8ef040>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:52.527320 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b08e074f-d756-4e98-a8ae-4c9b6d655215 tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.084539 Nov 24 16:14:52.527880 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 546/1112] 10.222.0.72 () {58 vars in 1133 bytes} [Wed Nov 24 16:14:52 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:14:52.539413 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1717914e-e3d9-44ae-9407-85ca07c81b33 tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] Calling method '.version_select at 0x7f361a86f9d0>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:52.621391 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1717914e-e3d9-44ae-9407-85ca07c81b33 tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.085202 Nov 24 16:14:52.621958 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 567/1113] 10.222.0.72 () {58 vars in 1166 bytes} [Wed Nov 24 16:14:52 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:14:52.634300 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e27e9a47-7388-4fbb-ad6c-54208307a246 tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] Calling method '.version_select at 0x7f361a8fcf70>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:52.718989 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e27e9a47-7388-4fbb-ad6c-54208307a246 tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088228 Nov 24 16:14:52.719567 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 547/1114] 10.222.0.72 () {58 vars in 1169 bytes} [Wed Nov 24 16:14:52 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:14:52.732315 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-88fdfbed-4b8b-4d5f-85ec-20e14e8c274d tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] Calling method '.version_select at 0x7f361a8855e0>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:52.817726 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-88fdfbed-4b8b-4d5f-85ec-20e14e8c274d tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.089699 Nov 24 16:14:52.818420 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 568/1115] 10.222.0.72 () {58 vars in 1154 bytes} [Wed Nov 24 16:14:52 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:14:52.830349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d01f02af-e6c4-42b2-8f1a-dd3b1103a926 tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] Calling method '.version_select at 0x7f361a939790>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:52.913771 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d01f02af-e6c4-42b2-8f1a-dd3b1103a926 tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.087909 Nov 24 16:14:52.914342 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 548/1116] 10.222.0.72 () {58 vars in 1187 bytes} [Wed Nov 24 16:14:52 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:14:52.929702 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8514ff7a-f78d-4835-8584-fd2cd0e27f4f tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] Calling method '.version_select at 0x7f361a90a8b0>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:14:53.014350 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8514ff7a-f78d-4835-8584-fd2cd0e27f4f tempest-VolumesTestJSON-2041926259 tempest-VolumesTestJSON-2041926259-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.091054 Nov 24 16:14:53.014924 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 569/1117] 10.222.0.72 () {58 vars in 1154 bytes} [Wed Nov 24 16:14:52 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:15:20.349171 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:15:20.349799 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: Wed Nov 24 16:15:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:15:27.190407 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0dd6e3a5-27dc-49a2-bd5b-4f54da3d3c56 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:27.191300 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0dd6e3a5-27dc-49a2-bd5b-4f54da3d3c56 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:27.197329 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0dd6e3a5-27dc-49a2-bd5b-4f54da3d3c56 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:27.197781 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0dd6e3a5-27dc-49a2-bd5b-4f54da3d3c56 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:27.198564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0dd6e3a5-27dc-49a2-bd5b-4f54da3d3c56 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:27.199003 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0dd6e3a5-27dc-49a2-bd5b-4f54da3d3c56 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:27.227596 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0dd6e3a5-27dc-49a2-bd5b-4f54da3d3c56 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041690 Nov 24 16:15:27.228156 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 549/1118] 10.222.0.72 () {60 vars in 1342 bytes} [Wed Nov 24 16:15:27 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:15:27.284609 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e2aeb471-297b-4f96-bae5-95874cc2fa51 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:27.285162 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e2aeb471-297b-4f96-bae5-95874cc2fa51 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:27.291039 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e2aeb471-297b-4f96-bae5-95874cc2fa51 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:27.291487 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e2aeb471-297b-4f96-bae5-95874cc2fa51 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:27.292263 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e2aeb471-297b-4f96-bae5-95874cc2fa51 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:27.292696 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e2aeb471-297b-4f96-bae5-95874cc2fa51 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:27.317645 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e2aeb471-297b-4f96-bae5-95874cc2fa51 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Going to try to terminate instance {{(pid=116303) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:15:27.394276 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e2aeb471-297b-4f96-bae5-95874cc2fa51 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 204 len: 0 microversion: 2.20 time: 0.114128 Nov 24 16:15:27.394817 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 570/1119] 10.222.0.72 () {60 vars in 1279 bytes} [Wed Nov 24 16:15:27 2021] DELETE /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 16:15:27.403115 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cd4b9c51-1112-4515-b692-652c74a13254 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:27.403720 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cd4b9c51-1112-4515-b692-652c74a13254 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:27.410358 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd4b9c51-1112-4515-b692-652c74a13254 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:27.410811 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd4b9c51-1112-4515-b692-652c74a13254 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:27.411593 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd4b9c51-1112-4515-b692-652c74a13254 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:27.412031 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cd4b9c51-1112-4515-b692-652c74a13254 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:27.692990 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cd4b9c51-1112-4515-b692-652c74a13254 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:27.700780 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cd4b9c51-1112-4515-b692-652c74a13254 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:27.702350 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cd4b9c51-1112-4515-b692-652c74a13254 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:27.703486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cd4b9c51-1112-4515-b692-652c74a13254 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.304152 Nov 24 16:15:27.704041 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 550/1120] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:15:27 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 16:15:28.723613 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-cc650c5b-4e14-44b7-a9ea-d7110dfc9670 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:28.724462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-cc650c5b-4e14-44b7-a9ea-d7110dfc9670 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:28.730809 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cc650c5b-4e14-44b7-a9ea-d7110dfc9670 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:28.731344 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cc650c5b-4e14-44b7-a9ea-d7110dfc9670 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:28.732134 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cc650c5b-4e14-44b7-a9ea-d7110dfc9670 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:28.733336 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-cc650c5b-4e14-44b7-a9ea-d7110dfc9670 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:28.923398 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-cc650c5b-4e14-44b7-a9ea-d7110dfc9670 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:28.931259 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-cc650c5b-4e14-44b7-a9ea-d7110dfc9670 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:28.932752 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-cc650c5b-4e14-44b7-a9ea-d7110dfc9670 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:28.933926 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-cc650c5b-4e14-44b7-a9ea-d7110dfc9670 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.214487 Nov 24 16:15:28.934479 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 571/1121] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:15:28 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:15:29.952119 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ba08b6d7-68ed-499a-a2b0-e62cee8b0e6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:29.952731 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ba08b6d7-68ed-499a-a2b0-e62cee8b0e6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:29.959699 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ba08b6d7-68ed-499a-a2b0-e62cee8b0e6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:29.960141 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ba08b6d7-68ed-499a-a2b0-e62cee8b0e6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:29.960915 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ba08b6d7-68ed-499a-a2b0-e62cee8b0e6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:29.961390 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ba08b6d7-68ed-499a-a2b0-e62cee8b0e6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:30.093925 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ba08b6d7-68ed-499a-a2b0-e62cee8b0e6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:30.101894 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ba08b6d7-68ed-499a-a2b0-e62cee8b0e6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:30.103406 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ba08b6d7-68ed-499a-a2b0-e62cee8b0e6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:30.104507 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ba08b6d7-68ed-499a-a2b0-e62cee8b0e6f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.156146 Nov 24 16:15:30.105077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 551/1122] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:15:29 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:15:31.123209 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4c8c8845-d86a-4032-9f0c-290f8d60006c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:31.123895 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4c8c8845-d86a-4032-9f0c-290f8d60006c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:31.131020 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4c8c8845-d86a-4032-9f0c-290f8d60006c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:31.131570 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4c8c8845-d86a-4032-9f0c-290f8d60006c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:31.132260 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4c8c8845-d86a-4032-9f0c-290f8d60006c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:31.132746 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4c8c8845-d86a-4032-9f0c-290f8d60006c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:31.262154 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4c8c8845-d86a-4032-9f0c-290f8d60006c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:31.270856 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4c8c8845-d86a-4032-9f0c-290f8d60006c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:31.272344 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4c8c8845-d86a-4032-9f0c-290f8d60006c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:31.273530 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4c8c8845-d86a-4032-9f0c-290f8d60006c tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.154351 Nov 24 16:15:31.274083 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 572/1123] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:15:31 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:15:32.291426 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ffb08817-09f0-47cd-98cf-e175baa172e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:32.292033 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ffb08817-09f0-47cd-98cf-e175baa172e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:32.299565 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffb08817-09f0-47cd-98cf-e175baa172e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:32.300020 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffb08817-09f0-47cd-98cf-e175baa172e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:32.301091 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffb08817-09f0-47cd-98cf-e175baa172e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:32.301747 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ffb08817-09f0-47cd-98cf-e175baa172e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:32.497810 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ffb08817-09f0-47cd-98cf-e175baa172e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:32.506878 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ffb08817-09f0-47cd-98cf-e175baa172e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:32.508412 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ffb08817-09f0-47cd-98cf-e175baa172e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:32.509714 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ffb08817-09f0-47cd-98cf-e175baa172e2 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1722 microversion: 2.20 time: 0.221886 Nov 24 16:15:32.510179 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 552/1124] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:15:32 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:15:33.209086 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-97b27a1a-22f1-452e-ae73-1c36c7eecb6b req-d604c25a-54a7-4d4f-a8e0-45f6e93b92f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b62212ea-7c11-4095-adf5-a78b04d67de0", "name": "network-vif-deleted", "tag": "4d38b5c2-e149-4f9c-bcdf-1f06131c0c44"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:15:33.209086 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:15:33.209086 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:15:33.216827 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-97b27a1a-22f1-452e-ae73-1c36c7eecb6b req-d604c25a-54a7-4d4f-a8e0-45f6e93b92f8 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:33.217300 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-97b27a1a-22f1-452e-ae73-1c36c7eecb6b req-d604c25a-54a7-4d4f-a8e0-45f6e93b92f8 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:33.228610 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-97b27a1a-22f1-452e-ae73-1c36c7eecb6b req-d604c25a-54a7-4d4f-a8e0-45f6e93b92f8 service nova] Creating event network-vif-deleted:4d38b5c2-e149-4f9c-bcdf-1f06131c0c44 for instance b62212ea-7c11-4095-adf5-a78b04d67de0 on hv-cinder-81899 Nov 24 16:15:33.233899 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-97b27a1a-22f1-452e-ae73-1c36c7eecb6b req-d604c25a-54a7-4d4f-a8e0-45f6e93b92f8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030764 Nov 24 16:15:33.234451 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 573/1125] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:15:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:15:33.527532 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6f56ebb0-5f91-4bfd-bd1a-edaf15432ee7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:33.528121 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6f56ebb0-5f91-4bfd-bd1a-edaf15432ee7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:33.535220 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6f56ebb0-5f91-4bfd-bd1a-edaf15432ee7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:33.535732 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6f56ebb0-5f91-4bfd-bd1a-edaf15432ee7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:33.536526 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6f56ebb0-5f91-4bfd-bd1a-edaf15432ee7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:33.537177 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6f56ebb0-5f91-4bfd-bd1a-edaf15432ee7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:33.575990 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6f56ebb0-5f91-4bfd-bd1a-edaf15432ee7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:33.576659 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6f56ebb0-5f91-4bfd-bd1a-edaf15432ee7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:33.577294 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-6f56ebb0-5f91-4bfd-bd1a-edaf15432ee7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lazy-loading 'fault' on Instance uuid b62212ea-7c11-4095-adf5-a78b04d67de0 {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:15:33.665081 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6f56ebb0-5f91-4bfd-bd1a-edaf15432ee7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:33.680156 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6f56ebb0-5f91-4bfd-bd1a-edaf15432ee7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:33.681954 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6f56ebb0-5f91-4bfd-bd1a-edaf15432ee7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a8a03093ef0437eb8da451bee7dcade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca913475fb04e7a8ea75d95578c8b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:33.683262 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6f56ebb0-5f91-4bfd-bd1a-edaf15432ee7 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 200 len: 1371 microversion: 2.20 time: 0.159332 Nov 24 16:15:33.684145 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 553/1126] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:15:33 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 16:15:34.703031 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-aae29194-a4d8-4f2c-bef6-99992f045808 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:34.703728 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-aae29194-a4d8-4f2c-bef6-99992f045808 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:34.710453 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aae29194-a4d8-4f2c-bef6-99992f045808 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:34.710898 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aae29194-a4d8-4f2c-bef6-99992f045808 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:34.711677 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aae29194-a4d8-4f2c-bef6-99992f045808 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:34.712113 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-aae29194-a4d8-4f2c-bef6-99992f045808 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:34.726544 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-aae29194-a4d8-4f2c-bef6-99992f045808 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] HTTP exception thrown: Instance b62212ea-7c11-4095-adf5-a78b04d67de0 could not be found. Nov 24 16:15:34.727128 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-aae29194-a4d8-4f2c-bef6-99992f045808 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Returning 404 to user: Instance b62212ea-7c11-4095-adf5-a78b04d67de0 could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:15:34.727933 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-aae29194-a4d8-4f2c-bef6-99992f045808 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 404 len: 111 microversion: 2.20 time: 0.029489 Nov 24 16:15:34.728457 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 574/1127] 10.222.0.72 () {60 vars in 1276 bytes} [Wed Nov 24 16:15:34 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 24 16:15:34.736628 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d90168bd-8b64-4d33-8262-20c7f293c218 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '.version_select at 0x7f361a93caf0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:34.754573 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d90168bd-8b64-4d33-8262-20c7f293c218 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-240747284" status: 204 len: 0 microversion: 2.20 time: 0.021561 Nov 24 16:15:34.755172 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 554/1128] 10.222.0.72 () {60 vars in 1258 bytes} [Wed Nov 24 16:15:34 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-240747284 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 24 16:15:39.668665 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8811929b-81ac-4612-8175-99cfe13191b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:39.669245 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8811929b-81ac-4612-8175-99cfe13191b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:39.675472 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8811929b-81ac-4612-8175-99cfe13191b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:39.675911 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8811929b-81ac-4612-8175-99cfe13191b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:39.676679 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8811929b-81ac-4612-8175-99cfe13191b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:39.677139 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8811929b-81ac-4612-8175-99cfe13191b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:39.690060 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-8811929b-81ac-4612-8175-99cfe13191b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] HTTP exception thrown: Instance b62212ea-7c11-4095-adf5-a78b04d67de0 could not be found. Nov 24 16:15:39.691396 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8811929b-81ac-4612-8175-99cfe13191b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Returning 404 to user: Instance b62212ea-7c11-4095-adf5-a78b04d67de0 could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:15:39.692195 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8811929b-81ac-4612-8175-99cfe13191b5 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 404 len: 111 microversion: 2.1 time: 0.027214 Nov 24 16:15:39.692782 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 575/1129] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:15:39 2021] DELETE /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:15:39.700956 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-081fdd6c-7804-4b43-90c9-9f878e95862f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:39.701666 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-081fdd6c-7804-4b43-90c9-9f878e95862f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: b62212ea-7c11-4095-adf5-a78b04d67de0] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:39.708984 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-081fdd6c-7804-4b43-90c9-9f878e95862f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:39.709470 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-081fdd6c-7804-4b43-90c9-9f878e95862f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:39.710254 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-081fdd6c-7804-4b43-90c9-9f878e95862f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:39.710691 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-081fdd6c-7804-4b43-90c9-9f878e95862f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:39.723378 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-081fdd6c-7804-4b43-90c9-9f878e95862f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] HTTP exception thrown: Instance b62212ea-7c11-4095-adf5-a78b04d67de0 could not be found. Nov 24 16:15:39.723958 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-081fdd6c-7804-4b43-90c9-9f878e95862f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Returning 404 to user: Instance b62212ea-7c11-4095-adf5-a78b04d67de0 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:15:39.724874 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-081fdd6c-7804-4b43-90c9-9f878e95862f tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0" status: 404 len: 111 microversion: 2.1 time: 0.027991 Nov 24 16:15:39.725552 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 555/1130] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:15:39 2021] GET /compute/v2.1/servers/b62212ea-7c11-4095-adf5-a78b04d67de0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:15:40.859674 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5db3bac1-f510-48f1-a062-84f3fd75bdda tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:40.860195 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5db3bac1-f510-48f1-a062-84f3fd75bdda tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:40.866673 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5db3bac1-f510-48f1-a062-84f3fd75bdda tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:40.867122 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5db3bac1-f510-48f1-a062-84f3fd75bdda tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:40.867899 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5db3bac1-f510-48f1-a062-84f3fd75bdda tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:40.868332 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5db3bac1-f510-48f1-a062-84f3fd75bdda tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:40.882368 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-5db3bac1-f510-48f1-a062-84f3fd75bdda tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] HTTP exception thrown: Instance 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 could not be found. Nov 24 16:15:40.882954 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5db3bac1-f510-48f1-a062-84f3fd75bdda tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Returning 404 to user: Instance 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:15:40.883767 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5db3bac1-f510-48f1-a062-84f3fd75bdda tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 404 len: 111 microversion: 2.1 time: 0.027768 Nov 24 16:15:40.884298 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 576/1131] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:15:40 2021] DELETE /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:15:40.892169 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-98b5cb74-c020-4597-93ce-36831d24d128 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:40.892778 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-98b5cb74-c020-4597-93ce-36831d24d128 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] [instance: 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:40.899542 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-98b5cb74-c020-4597-93ce-36831d24d128 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:40.900001 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-98b5cb74-c020-4597-93ce-36831d24d128 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:40.900784 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-98b5cb74-c020-4597-93ce-36831d24d128 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:40.901257 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-98b5cb74-c020-4597-93ce-36831d24d128 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:40.914743 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-98b5cb74-c020-4597-93ce-36831d24d128 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] HTTP exception thrown: Instance 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 could not be found. Nov 24 16:15:40.915326 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-98b5cb74-c020-4597-93ce-36831d24d128 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] Returning 404 to user: Instance 2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:15:40.916134 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-98b5cb74-c020-4597-93ce-36831d24d128 tempest-AttachVolumeShelveTestJSON-1528064914 tempest-AttachVolumeShelveTestJSON-1528064914-project] 10.222.0.72 "GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6" status: 404 len: 111 microversion: 2.1 time: 0.027719 Nov 24 16:15:40.916666 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 556/1132] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:15:40 2021] GET /compute/v2.1/servers/2559a4b2-b8d8-46b6-a413-5a6dd5fb22b6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:15:54.528706 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1132552015", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:15:54.581622 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.network.neutron [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] validate_networks() for None {{(pid=116303) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:15:54.847759 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Flavor limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:15:54.848757 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Image limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:15:54.849266 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Flavor pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:15:54.849674 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Image pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:15:54.850125 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:15:54.859351 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:54.859794 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:54.860600 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:54.861048 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:54.877709 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Getting quotas for project c0e147459fcd40c79d08ae9c01f7657d. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:15:54.881815 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Getting quotas for user 21bbcc77bc374afe92cf1f391fede10f and project c0e147459fcd40c79d08ae9c01f7657d. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:15:54.892529 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Going to run 1 instances... {{(pid=116303) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:15:54.894870 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:15:54.940654 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-95964d7b-ee0d-4580-850c-d5669b5003e0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.415695 Nov 24 16:15:54.941335 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 577/1133] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:15:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:15:54.951292 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-61b5a0d2-0b76-483d-b5f7-778cb0a990f0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:54.952009 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-61b5a0d2-0b76-483d-b5f7-778cb0a990f0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:55.008232 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-61b5a0d2-0b76-483d-b5f7-778cb0a990f0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:55.014643 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-61b5a0d2-0b76-483d-b5f7-778cb0a990f0 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1215 microversion: 2.1 time: 0.067148 Nov 24 16:15:55.015237 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 557/1134] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:15:54 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:15:56.032698 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-52d285cd-f60a-4bd1-ac46-a792c1b7deea tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:56.033346 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-52d285cd-f60a-4bd1-ac46-a792c1b7deea tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:56.040022 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-52d285cd-f60a-4bd1-ac46-a792c1b7deea tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:56.040498 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-52d285cd-f60a-4bd1-ac46-a792c1b7deea tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:56.041311 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-52d285cd-f60a-4bd1-ac46-a792c1b7deea tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:56.041747 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-52d285cd-f60a-4bd1-ac46-a792c1b7deea tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:56.103689 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-52d285cd-f60a-4bd1-ac46-a792c1b7deea tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:56.111117 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-52d285cd-f60a-4bd1-ac46-a792c1b7deea tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1219 microversion: 2.1 time: 0.082557 Nov 24 16:15:56.111673 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 578/1135] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:15:56 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:15:57.127814 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-61b876c0-f8ba-4e82-a195-e71df85e316e tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:57.128411 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-61b876c0-f8ba-4e82-a195-e71df85e316e tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:57.136180 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-61b876c0-f8ba-4e82-a195-e71df85e316e tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:57.136632 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-61b876c0-f8ba-4e82-a195-e71df85e316e tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:57.137455 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-61b876c0-f8ba-4e82-a195-e71df85e316e tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:57.137892 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-61b876c0-f8ba-4e82-a195-e71df85e316e tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:57.199547 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-61b876c0-f8ba-4e82-a195-e71df85e316e tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:57.206820 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-61b876c0-f8ba-4e82-a195-e71df85e316e tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1211 microversion: 2.1 time: 0.082656 Nov 24 16:15:57.208361 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 558/1136] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:15:57 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:15:58.224099 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0dac5c40-268d-456f-a64b-37b96be2b06d tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:58.224708 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0dac5c40-268d-456f-a64b-37b96be2b06d tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:58.231140 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0dac5c40-268d-456f-a64b-37b96be2b06d tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:58.231588 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0dac5c40-268d-456f-a64b-37b96be2b06d tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:58.232374 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0dac5c40-268d-456f-a64b-37b96be2b06d tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:58.232813 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0dac5c40-268d-456f-a64b-37b96be2b06d tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:58.295827 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-0dac5c40-268d-456f-a64b-37b96be2b06d tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:58.303738 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0dac5c40-268d-456f-a64b-37b96be2b06d tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1211 microversion: 2.1 time: 0.083404 Nov 24 16:15:58.304408 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 579/1137] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:15:58 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:15:59.321591 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-80a34d04-338a-4d2a-9710-1dcd79cbef3c tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:15:59.322208 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-80a34d04-338a-4d2a-9710-1dcd79cbef3c tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:15:59.328800 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-80a34d04-338a-4d2a-9710-1dcd79cbef3c tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:59.329287 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-80a34d04-338a-4d2a-9710-1dcd79cbef3c tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:59.330080 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-80a34d04-338a-4d2a-9710-1dcd79cbef3c tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:15:59.330526 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-80a34d04-338a-4d2a-9710-1dcd79cbef3c tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:15:59.407271 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-80a34d04-338a-4d2a-9710-1dcd79cbef3c tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:15:59.415156 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-80a34d04-338a-4d2a-9710-1dcd79cbef3c tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1273 microversion: 2.1 time: 0.099246 Nov 24 16:15:59.424479 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 559/1138] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:15:59 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:00.431877 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c614e084-8582-425e-ba83-72ad0e255e7b tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:00.432550 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c614e084-8582-425e-ba83-72ad0e255e7b tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:00.440922 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c614e084-8582-425e-ba83-72ad0e255e7b tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:00.441752 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c614e084-8582-425e-ba83-72ad0e255e7b tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:00.443298 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c614e084-8582-425e-ba83-72ad0e255e7b tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:00.443949 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c614e084-8582-425e-ba83-72ad0e255e7b tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:00.584049 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-4af1bc8b-f70b-432e-b93f-dcb7f0484e0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78562530-30d1-4369-972e-a3163737ddc3", "tag": "1d243d6e-8ba5-4a7d-8c23-424e8d461fb7"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:16:00.585956 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:16:00.585956 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:16:00.593320 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-4af1bc8b-f70b-432e-b93f-dcb7f0484e0d service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:00.593770 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-4af1bc8b-f70b-432e-b93f-dcb7f0484e0d service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:00.605935 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-4af1bc8b-f70b-432e-b93f-dcb7f0484e0d service nova] Creating event network-changed:1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 for instance 78562530-30d1-4369-972e-a3163737ddc3 on hv-cinder-81899 Nov 24 16:16:00.611868 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-75b9b942-00ef-4974-a4fe-563580a2f666 req-4af1bc8b-f70b-432e-b93f-dcb7f0484e0d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182672 Nov 24 16:16:00.612846 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 580/1139] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:16:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:16:00.685591 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c614e084-8582-425e-ba83-72ad0e255e7b tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:00.693110 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c614e084-8582-425e-ba83-72ad0e255e7b tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1315 microversion: 2.1 time: 0.264875 Nov 24 16:16:00.693632 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 560/1140] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:00 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:16:01.710720 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ff6239bf-5ddd-4b7e-9e0e-595a189cdb94 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:01.711420 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ff6239bf-5ddd-4b7e-9e0e-595a189cdb94 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:01.717914 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ff6239bf-5ddd-4b7e-9e0e-595a189cdb94 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:01.718366 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ff6239bf-5ddd-4b7e-9e0e-595a189cdb94 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:01.719150 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ff6239bf-5ddd-4b7e-9e0e-595a189cdb94 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:01.719586 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ff6239bf-5ddd-4b7e-9e0e-595a189cdb94 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:01.851475 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-ff6239bf-5ddd-4b7e-9e0e-595a189cdb94 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:01.858716 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ff6239bf-5ddd-4b7e-9e0e-595a189cdb94 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1315 microversion: 2.1 time: 0.152637 Nov 24 16:16:01.859271 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 581/1141] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:01 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:02.875895 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-e1e1cd76-8a23-4312-9a0a-bf8712267d15 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:02.876580 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-e1e1cd76-8a23-4312-9a0a-bf8712267d15 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:02.885747 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e1e1cd76-8a23-4312-9a0a-bf8712267d15 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:02.886201 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e1e1cd76-8a23-4312-9a0a-bf8712267d15 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:02.886990 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e1e1cd76-8a23-4312-9a0a-bf8712267d15 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:02.887610 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-e1e1cd76-8a23-4312-9a0a-bf8712267d15 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:03.029941 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-e1e1cd76-8a23-4312-9a0a-bf8712267d15 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:03.038572 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-e1e1cd76-8a23-4312-9a0a-bf8712267d15 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1315 microversion: 2.1 time: 0.166493 Nov 24 16:16:03.039155 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 561/1142] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:02 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:04.057170 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7a11b60b-0e93-42b5-b417-2ace55c100f1 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:04.057797 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7a11b60b-0e93-42b5-b417-2ace55c100f1 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:04.064176 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7a11b60b-0e93-42b5-b417-2ace55c100f1 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:04.064853 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7a11b60b-0e93-42b5-b417-2ace55c100f1 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:04.065719 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7a11b60b-0e93-42b5-b417-2ace55c100f1 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:04.066160 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7a11b60b-0e93-42b5-b417-2ace55c100f1 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:04.292231 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7a11b60b-0e93-42b5-b417-2ace55c100f1 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:04.300450 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7a11b60b-0e93-42b5-b417-2ace55c100f1 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1315 microversion: 2.1 time: 0.247027 Nov 24 16:16:04.301479 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 582/1143] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:04 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:05.319477 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a6477700-d752-43ff-9381-6391d4bb9550 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:05.320828 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a6477700-d752-43ff-9381-6391d4bb9550 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:05.328269 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a6477700-d752-43ff-9381-6391d4bb9550 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:05.328995 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a6477700-d752-43ff-9381-6391d4bb9550 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:05.330474 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a6477700-d752-43ff-9381-6391d4bb9550 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:05.330618 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a6477700-d752-43ff-9381-6391d4bb9550 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:05.515417 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a6477700-d752-43ff-9381-6391d4bb9550 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:05.525776 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a6477700-d752-43ff-9381-6391d4bb9550 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1315 microversion: 2.1 time: 0.211342 Nov 24 16:16:05.526422 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 562/1144] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:05 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:06.050181 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-4213e0c0-7e8f-4e98-903c-4e76481129cc req-2de7f476-77f7-4286-a95c-c91a0104cc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78562530-30d1-4369-972e-a3163737ddc3", "name": "network-vif-plugged", "status": "completed", "tag": "1d243d6e-8ba5-4a7d-8c23-424e8d461fb7"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:16:06.053155 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:16:06.053155 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:16:06.062135 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-4213e0c0-7e8f-4e98-903c-4e76481129cc req-2de7f476-77f7-4286-a95c-c91a0104cc4b service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:06.063111 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-4213e0c0-7e8f-4e98-903c-4e76481129cc req-2de7f476-77f7-4286-a95c-c91a0104cc4b service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:06.076144 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-4213e0c0-7e8f-4e98-903c-4e76481129cc req-2de7f476-77f7-4286-a95c-c91a0104cc4b service nova] Creating event network-vif-plugged:1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 for instance 78562530-30d1-4369-972e-a3163737ddc3 on hv-cinder-81899 Nov 24 16:16:06.082238 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-4213e0c0-7e8f-4e98-903c-4e76481129cc req-2de7f476-77f7-4286-a95c-c91a0104cc4b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035947 Nov 24 16:16:06.083646 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 583/1145] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:16:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:16:06.544342 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0d1e36e3-5fe4-4854-8504-bca2b13f95f6 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:06.545319 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0d1e36e3-5fe4-4854-8504-bca2b13f95f6 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:06.553227 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0d1e36e3-5fe4-4854-8504-bca2b13f95f6 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:06.553797 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0d1e36e3-5fe4-4854-8504-bca2b13f95f6 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:06.555081 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0d1e36e3-5fe4-4854-8504-bca2b13f95f6 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:06.555519 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0d1e36e3-5fe4-4854-8504-bca2b13f95f6 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:06.914516 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0d1e36e3-5fe4-4854-8504-bca2b13f95f6 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:06.922510 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0d1e36e3-5fe4-4854-8504-bca2b13f95f6 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1315 microversion: 2.1 time: 0.382103 Nov 24 16:16:06.923454 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 563/1146] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:06 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:07.943266 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e424ab88-4a75-4114-8762-389b8f4db4dd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:07.945239 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e424ab88-4a75-4114-8762-389b8f4db4dd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:07.952909 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e424ab88-4a75-4114-8762-389b8f4db4dd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:07.953609 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e424ab88-4a75-4114-8762-389b8f4db4dd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:07.954573 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e424ab88-4a75-4114-8762-389b8f4db4dd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:07.955170 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e424ab88-4a75-4114-8762-389b8f4db4dd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:08.131036 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-e424ab88-4a75-4114-8762-389b8f4db4dd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:08.139776 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e424ab88-4a75-4114-8762-389b8f4db4dd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1465 microversion: 2.1 time: 0.202943 Nov 24 16:16:08.140907 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 584/1147] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:07 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1465 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:08.191092 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:08.192897 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:08.202838 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:08.203542 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:08.204510 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:08.205183 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:08.240655 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:16:08.339949 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-549e10ea-cfa6-42ee-8b38-28bd5ad9d4e7 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "DELETE /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 204 len: 0 microversion: 2.1 time: 0.152206 Nov 24 16:16:08.341868 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 564/1148] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:16:08 2021] DELETE /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:16:08.351610 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fb8ad700-495b-4229-9d76-cde1f97b2e08 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:08.352237 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fb8ad700-495b-4229-9d76-cde1f97b2e08 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:08.358690 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fb8ad700-495b-4229-9d76-cde1f97b2e08 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:08.359148 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fb8ad700-495b-4229-9d76-cde1f97b2e08 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:08.359949 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fb8ad700-495b-4229-9d76-cde1f97b2e08 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:08.360382 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fb8ad700-495b-4229-9d76-cde1f97b2e08 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:08.520838 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-fb8ad700-495b-4229-9d76-cde1f97b2e08 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:08.529607 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fb8ad700-495b-4229-9d76-cde1f97b2e08 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1471 microversion: 2.1 time: 0.182467 Nov 24 16:16:08.530186 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 585/1149] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:08 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:16:09.549964 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-400da76a-f45c-4b51-a8c1-90f62a363cfd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:09.550555 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-400da76a-f45c-4b51-a8c1-90f62a363cfd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:09.569597 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-400da76a-f45c-4b51-a8c1-90f62a363cfd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:09.570728 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-400da76a-f45c-4b51-a8c1-90f62a363cfd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:09.571807 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-400da76a-f45c-4b51-a8c1-90f62a363cfd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:09.576283 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-400da76a-f45c-4b51-a8c1-90f62a363cfd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:09.792506 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-400da76a-f45c-4b51-a8c1-90f62a363cfd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:09.801760 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-400da76a-f45c-4b51-a8c1-90f62a363cfd tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1471 microversion: 2.1 time: 0.255216 Nov 24 16:16:09.804015 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 565/1150] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:09 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1471 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:10.372919 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-45606078-7b6f-40cd-8a67-a1b9feb3fa22 req-44ce1ff9-b13b-4b4e-b37e-24fff00b066b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78562530-30d1-4369-972e-a3163737ddc3", "name": "network-vif-deleted", "tag": "1d243d6e-8ba5-4a7d-8c23-424e8d461fb7"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:16:10.374525 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:16:10.374525 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:16:10.383204 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-45606078-7b6f-40cd-8a67-a1b9feb3fa22 req-44ce1ff9-b13b-4b4e-b37e-24fff00b066b service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:10.383654 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-45606078-7b6f-40cd-8a67-a1b9feb3fa22 req-44ce1ff9-b13b-4b4e-b37e-24fff00b066b service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:10.400415 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-45606078-7b6f-40cd-8a67-a1b9feb3fa22 req-44ce1ff9-b13b-4b4e-b37e-24fff00b066b service nova] Creating event network-vif-deleted:1d243d6e-8ba5-4a7d-8c23-424e8d461fb7 for instance 78562530-30d1-4369-972e-a3163737ddc3 on hv-cinder-81899 Nov 24 16:16:10.405569 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-45606078-7b6f-40cd-8a67-a1b9feb3fa22 req-44ce1ff9-b13b-4b4e-b37e-24fff00b066b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036545 Nov 24 16:16:10.409424 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 586/1151] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:16:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:16:10.821325 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-cbfba73d-8bb7-4b2c-ab79-7ac16ae4aa27 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:10.822138 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-cbfba73d-8bb7-4b2c-ab79-7ac16ae4aa27 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:10.829557 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cbfba73d-8bb7-4b2c-ab79-7ac16ae4aa27 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:10.830667 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cbfba73d-8bb7-4b2c-ab79-7ac16ae4aa27 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:10.832565 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cbfba73d-8bb7-4b2c-ab79-7ac16ae4aa27 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:10.833371 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cbfba73d-8bb7-4b2c-ab79-7ac16ae4aa27 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:10.877514 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cbfba73d-8bb7-4b2c-ab79-7ac16ae4aa27 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:10.878305 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-cbfba73d-8bb7-4b2c-ab79-7ac16ae4aa27 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:10.879047 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-cbfba73d-8bb7-4b2c-ab79-7ac16ae4aa27 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lazy-loading 'fault' on Instance uuid 78562530-30d1-4369-972e-a3163737ddc3 {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:16:10.933198 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-cbfba73d-8bb7-4b2c-ab79-7ac16ae4aa27 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21bbcc77bc374afe92cf1f391fede10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e147459fcd40c79d08ae9c01f7657d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:10.948621 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-cbfba73d-8bb7-4b2c-ab79-7ac16ae4aa27 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 200 len: 1305 microversion: 2.1 time: 0.131902 Nov 24 16:16:10.949851 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 566/1152] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:10 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 1305 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:11.973943 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0fed88ca-e9e2-400f-9ea3-518a1a48e492 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:11.976514 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0fed88ca-e9e2-400f-9ea3-518a1a48e492 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] [instance: 78562530-30d1-4369-972e-a3163737ddc3] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:11.985589 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0fed88ca-e9e2-400f-9ea3-518a1a48e492 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:11.986396 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0fed88ca-e9e2-400f-9ea3-518a1a48e492 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:11.987369 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0fed88ca-e9e2-400f-9ea3-518a1a48e492 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:11.990134 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0fed88ca-e9e2-400f-9ea3-518a1a48e492 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:12.015274 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-0fed88ca-e9e2-400f-9ea3-518a1a48e492 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] HTTP exception thrown: Instance 78562530-30d1-4369-972e-a3163737ddc3 could not be found. Nov 24 16:16:12.015884 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0fed88ca-e9e2-400f-9ea3-518a1a48e492 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] Returning 404 to user: Instance 78562530-30d1-4369-972e-a3163737ddc3 could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:16:12.016733 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0fed88ca-e9e2-400f-9ea3-518a1a48e492 tempest-VolumesNegativeTest-1875274966 tempest-VolumesNegativeTest-1875274966-project] 10.222.0.72 "GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3" status: 404 len: 111 microversion: 2.1 time: 0.052828 Nov 24 16:16:12.025164 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 587/1153] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:11 2021] GET /compute/v2.1/servers/78562530-30d1-4369-972e-a3163737ddc3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:16:14.124121 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a4baf483-03a7-4924-b0c0-9ea2f9e05d9b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Action: 'create', calling method: .version_select at 0x7f361a9acaf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1778100134"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:16:14.139601 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-a4baf483-03a7-4924-b0c0-9ea2f9e05d9b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Getting quotas for project 7ae2d50102bf491986834edf07a6a868. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:16:14.143729 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-a4baf483-03a7-4924-b0c0-9ea2f9e05d9b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Getting quotas for user 1181f7a15e6d4732865fe02f985bf189 and project 7ae2d50102bf491986834edf07a6a868. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:16:14.393708 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-a4baf483-03a7-4924-b0c0-9ea2f9e05d9b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Getting quotas for project 7ae2d50102bf491986834edf07a6a868. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:16:14.398541 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-a4baf483-03a7-4924-b0c0-9ea2f9e05d9b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Getting quotas for user 1181f7a15e6d4732865fe02f985bf189 and project 7ae2d50102bf491986834edf07a6a868. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:16:14.413703 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a4baf483-03a7-4924-b0c0-9ea2f9e05d9b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.481143 Nov 24 16:16:14.414868 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 567/1154] 10.222.0.72 () {60 vars in 1157 bytes} [Wed Nov 24 16:16:13 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:20.416520 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1843944787", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "networks": [{"uuid": "8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2"}]}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:16:20.469271 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.network.neutron [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] validate_networks() for [('8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2', None, None, None, None, None)] {{(pid=116303) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:16:20.887158 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Flavor limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:16:20.887580 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Image limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:16:20.888053 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Flavor pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:16:20.888555 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Image pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:16:20.888976 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:16:20.898655 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:20.899121 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:20.899953 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:20.900388 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:20.917458 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Getting quotas for project 778d3476a1b6447c8b02c8eb73bfe48e. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:16:20.921432 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Getting quotas for user 6f22bc0e9e744d7f82784f76631f8d97 and project 778d3476a1b6447c8b02c8eb73bfe48e. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:16:20.933008 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Going to run 1 instances... {{(pid=116303) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:16:20.935360 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:16:20.981835 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b6e34f78-d38c-4a5c-9be9-00cbe884feaf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569024 Nov 24 16:16:20.982513 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 588/1155] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:16:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:16:20.992938 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f0d9ae86-8a25-4647-890d-9543cd277361 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:20.993652 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f0d9ae86-8a25-4647-890d-9543cd277361 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:21.046964 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f0d9ae86-8a25-4647-890d-9543cd277361 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:21.056232 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f0d9ae86-8a25-4647-890d-9543cd277361 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1219 microversion: 2.1 time: 0.067479 Nov 24 16:16:21.056845 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 568/1156] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:20 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:22.074590 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-008e829f-dc2a-4ef6-bb55-0c62fc371c1c tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:22.075324 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-008e829f-dc2a-4ef6-bb55-0c62fc371c1c tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:22.132533 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-008e829f-dc2a-4ef6-bb55-0c62fc371c1c tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:22.140297 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-008e829f-dc2a-4ef6-bb55-0c62fc371c1c tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1219 microversion: 2.1 time: 0.070717 Nov 24 16:16:22.140851 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 589/1157] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:22 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:16:23.158431 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-11780dbc-b1ea-4fee-8a0f-8bb9a01e7ae4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:23.158843 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-11780dbc-b1ea-4fee-8a0f-8bb9a01e7ae4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:23.220637 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-11780dbc-b1ea-4fee-8a0f-8bb9a01e7ae4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:23.231215 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-11780dbc-b1ea-4fee-8a0f-8bb9a01e7ae4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1219 microversion: 2.1 time: 0.076932 Nov 24 16:16:23.231827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 569/1158] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:23 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:24.248354 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2474232c-5185-4854-b764-355e2d6314e1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:24.248980 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2474232c-5185-4854-b764-355e2d6314e1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:24.305845 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-2474232c-5185-4854-b764-355e2d6314e1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:24.313335 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2474232c-5185-4854-b764-355e2d6314e1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1219 microversion: 2.1 time: 0.068885 Nov 24 16:16:24.314132 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 590/1159] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:24 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:25.332268 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a209ff65-03b2-48c6-8919-b3940e6725b6 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:25.332871 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a209ff65-03b2-48c6-8919-b3940e6725b6 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:25.341263 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a209ff65-03b2-48c6-8919-b3940e6725b6 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:25.341684 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a209ff65-03b2-48c6-8919-b3940e6725b6 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:25.342799 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a209ff65-03b2-48c6-8919-b3940e6725b6 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:25.343247 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a209ff65-03b2-48c6-8919-b3940e6725b6 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:25.404559 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a209ff65-03b2-48c6-8919-b3940e6725b6 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:25.412307 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a209ff65-03b2-48c6-8919-b3940e6725b6 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1223 microversion: 2.1 time: 0.083675 Nov 24 16:16:25.412890 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 570/1160] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:25 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:16:26.431090 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-16c33959-9e78-4c1a-bfb3-819f433f6782 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:26.431794 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-16c33959-9e78-4c1a-bfb3-819f433f6782 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:26.441729 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-16c33959-9e78-4c1a-bfb3-819f433f6782 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:26.442189 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-16c33959-9e78-4c1a-bfb3-819f433f6782 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:26.442989 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-16c33959-9e78-4c1a-bfb3-819f433f6782 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:26.443428 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-16c33959-9e78-4c1a-bfb3-819f433f6782 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:26.521231 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-16c33959-9e78-4c1a-bfb3-819f433f6782 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:26.535588 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-16c33959-9e78-4c1a-bfb3-819f433f6782 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1277 microversion: 2.1 time: 0.108486 Nov 24 16:16:26.546423 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 591/1161] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:26 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:27.530967 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-ba7d3ba9-5e9d-40f7-8a65-f3b0fd175c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7affc9c3-2c9c-4b32-91fc-e3a189845148", "tag": "0adfe968-26c2-481a-8821-0e1906cc8f14"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:16:27.533298 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:16:27.533298 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:16:27.543431 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-ba7d3ba9-5e9d-40f7-8a65-f3b0fd175c19 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:27.544067 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-ba7d3ba9-5e9d-40f7-8a65-f3b0fd175c19 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:27.556586 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ffc4a11d-473c-4fe1-980f-d70bff13b0e1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:27.558227 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ffc4a11d-473c-4fe1-980f-d70bff13b0e1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:27.565947 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ffc4a11d-473c-4fe1-980f-d70bff13b0e1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:27.566506 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ffc4a11d-473c-4fe1-980f-d70bff13b0e1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:27.567694 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ffc4a11d-473c-4fe1-980f-d70bff13b0e1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:27.567897 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ffc4a11d-473c-4fe1-980f-d70bff13b0e1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:27.578073 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-ba7d3ba9-5e9d-40f7-8a65-f3b0fd175c19 service nova] Creating event network-changed:0adfe968-26c2-481a-8821-0e1906cc8f14 for instance 7affc9c3-2c9c-4b32-91fc-e3a189845148 on hv-cinder-81899 Nov 24 16:16:27.587524 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-ca4e3280-4105-4892-b087-0c1d22700a23 req-ba7d3ba9-5e9d-40f7-8a65-f3b0fd175c19 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060678 Nov 24 16:16:27.590423 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 571/1162] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:16:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:16:27.736883 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-ffc4a11d-473c-4fe1-980f-d70bff13b0e1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:27.746023 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ffc4a11d-473c-4fe1-980f-d70bff13b0e1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1319 microversion: 2.1 time: 0.194776 Nov 24 16:16:27.746405 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 592/1163] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:27 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:28.765229 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-02c146e6-7715-4a9e-91d4-cc667efff55a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:28.765946 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-02c146e6-7715-4a9e-91d4-cc667efff55a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:28.772961 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-02c146e6-7715-4a9e-91d4-cc667efff55a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:28.773481 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-02c146e6-7715-4a9e-91d4-cc667efff55a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:28.774362 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-02c146e6-7715-4a9e-91d4-cc667efff55a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:28.774824 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-02c146e6-7715-4a9e-91d4-cc667efff55a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:28.962040 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-02c146e6-7715-4a9e-91d4-cc667efff55a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:28.969921 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-02c146e6-7715-4a9e-91d4-cc667efff55a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1319 microversion: 2.1 time: 0.209250 Nov 24 16:16:28.970506 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 572/1164] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:28 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:29.987899 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-780112e6-6621-45dd-a332-711f35ff4811 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:29.988512 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-780112e6-6621-45dd-a332-711f35ff4811 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:29.995638 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-780112e6-6621-45dd-a332-711f35ff4811 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:29.996087 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-780112e6-6621-45dd-a332-711f35ff4811 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:29.997556 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-780112e6-6621-45dd-a332-711f35ff4811 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:29.997687 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-780112e6-6621-45dd-a332-711f35ff4811 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:30.138850 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-780112e6-6621-45dd-a332-711f35ff4811 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:30.146237 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-780112e6-6621-45dd-a332-711f35ff4811 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1319 microversion: 2.1 time: 0.162278 Nov 24 16:16:30.146796 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 593/1165] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:29 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:31.163425 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a983db2f-b2b0-45a3-8052-e35973a26019 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:31.164838 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a983db2f-b2b0-45a3-8052-e35973a26019 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:31.171459 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a983db2f-b2b0-45a3-8052-e35973a26019 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:31.171907 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a983db2f-b2b0-45a3-8052-e35973a26019 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:31.172681 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a983db2f-b2b0-45a3-8052-e35973a26019 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:31.173160 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a983db2f-b2b0-45a3-8052-e35973a26019 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:31.307098 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a983db2f-b2b0-45a3-8052-e35973a26019 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:31.314410 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a983db2f-b2b0-45a3-8052-e35973a26019 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1319 microversion: 2.1 time: 0.154649 Nov 24 16:16:31.314972 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 573/1166] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:31 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:32.336065 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2d8b4092-86bb-4547-912e-c8f265da95cf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:32.336672 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2d8b4092-86bb-4547-912e-c8f265da95cf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:32.343869 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2d8b4092-86bb-4547-912e-c8f265da95cf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:32.344320 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2d8b4092-86bb-4547-912e-c8f265da95cf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:32.345147 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2d8b4092-86bb-4547-912e-c8f265da95cf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:32.345576 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2d8b4092-86bb-4547-912e-c8f265da95cf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:32.481480 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-2d8b4092-86bb-4547-912e-c8f265da95cf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:32.488854 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2d8b4092-86bb-4547-912e-c8f265da95cf tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1319 microversion: 2.1 time: 0.156528 Nov 24 16:16:32.489445 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 594/1167] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:32 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:33.506490 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-470b5e1b-d1a8-4a93-92ff-83c75aa5cbf9 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:33.507093 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-470b5e1b-d1a8-4a93-92ff-83c75aa5cbf9 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:33.514302 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-470b5e1b-d1a8-4a93-92ff-83c75aa5cbf9 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:33.514852 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-470b5e1b-d1a8-4a93-92ff-83c75aa5cbf9 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:33.515669 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-470b5e1b-d1a8-4a93-92ff-83c75aa5cbf9 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:33.516108 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-470b5e1b-d1a8-4a93-92ff-83c75aa5cbf9 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:33.651034 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-470b5e1b-d1a8-4a93-92ff-83c75aa5cbf9 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:33.658631 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-470b5e1b-d1a8-4a93-92ff-83c75aa5cbf9 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1319 microversion: 2.1 time: 0.155864 Nov 24 16:16:33.659571 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 574/1168] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:33 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:34.205150 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-14f8c75c-2d30-4201-8f8c-90885ebd9304 req-8aa08e2e-6473-4710-aa6f-437ebd9e3113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7affc9c3-2c9c-4b32-91fc-e3a189845148", "name": "network-vif-plugged", "status": "completed", "tag": "0adfe968-26c2-481a-8821-0e1906cc8f14"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:16:34.206740 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:16:34.206740 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:16:34.215621 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-14f8c75c-2d30-4201-8f8c-90885ebd9304 req-8aa08e2e-6473-4710-aa6f-437ebd9e3113 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:34.216061 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-14f8c75c-2d30-4201-8f8c-90885ebd9304 req-8aa08e2e-6473-4710-aa6f-437ebd9e3113 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:34.228887 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-14f8c75c-2d30-4201-8f8c-90885ebd9304 req-8aa08e2e-6473-4710-aa6f-437ebd9e3113 service nova] Creating event network-vif-plugged:0adfe968-26c2-481a-8821-0e1906cc8f14 for instance 7affc9c3-2c9c-4b32-91fc-e3a189845148 on hv-cinder-81899 Nov 24 16:16:34.235482 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-14f8c75c-2d30-4201-8f8c-90885ebd9304 req-8aa08e2e-6473-4710-aa6f-437ebd9e3113 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034107 Nov 24 16:16:34.236331 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 595/1169] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:16:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:16:34.676020 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c4f21ecc-0aad-4220-be06-b1a6b85fae42 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:34.676664 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c4f21ecc-0aad-4220-be06-b1a6b85fae42 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:34.684815 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c4f21ecc-0aad-4220-be06-b1a6b85fae42 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:34.685486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c4f21ecc-0aad-4220-be06-b1a6b85fae42 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:34.686301 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c4f21ecc-0aad-4220-be06-b1a6b85fae42 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:34.686731 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c4f21ecc-0aad-4220-be06-b1a6b85fae42 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:34.824332 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c4f21ecc-0aad-4220-be06-b1a6b85fae42 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:34.831869 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c4f21ecc-0aad-4220-be06-b1a6b85fae42 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1319 microversion: 2.1 time: 0.159811 Nov 24 16:16:34.832536 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 575/1170] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:34 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:35.850889 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3e23ea5c-2d55-4647-be99-a06c36425c2b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:35.851751 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3e23ea5c-2d55-4647-be99-a06c36425c2b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:35.859020 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e23ea5c-2d55-4647-be99-a06c36425c2b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:35.859465 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e23ea5c-2d55-4647-be99-a06c36425c2b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:35.860620 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e23ea5c-2d55-4647-be99-a06c36425c2b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:35.861081 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3e23ea5c-2d55-4647-be99-a06c36425c2b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:36.025001 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3e23ea5c-2d55-4647-be99-a06c36425c2b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:36.032989 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3e23ea5c-2d55-4647-be99-a06c36425c2b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1319 microversion: 2.1 time: 0.187040 Nov 24 16:16:36.033979 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 596/1171] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:35 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:37.051334 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f0622e7f-1a7e-4435-b815-af1054f6d0a3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:37.052136 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f0622e7f-1a7e-4435-b815-af1054f6d0a3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:37.058673 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0622e7f-1a7e-4435-b815-af1054f6d0a3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:37.059135 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0622e7f-1a7e-4435-b815-af1054f6d0a3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:37.059952 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0622e7f-1a7e-4435-b815-af1054f6d0a3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:37.060393 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f0622e7f-1a7e-4435-b815-af1054f6d0a3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:37.206621 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f0622e7f-1a7e-4435-b815-af1054f6d0a3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:37.214374 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f0622e7f-1a7e-4435-b815-af1054f6d0a3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1508 microversion: 2.1 time: 0.166869 Nov 24 16:16:37.214957 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 576/1172] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:37 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:37.259283 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-886904171", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1778100134", "security_groups": [{"name": "tempest-secgroup-smoke-504417305"}], "block_device_mapping_v2": [{"uuid": "85265789-1a65-490a-aafb-4b404cb0bcb2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e94d2a4c-106b-44d2-b8a7-a2440253d60c"}]}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:16:37.380584 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.network.neutron [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] validate_networks() for [('e94d2a4c-106b-44d2-b8a7-a2440253d60c', None, None, None, None, None)] {{(pid=116303) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:16:37.926005 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Flavor limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:16:37.926427 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Image limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:16:37.926882 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Flavor pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:16:37.927282 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Image pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:16:37.927750 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:16:37.944942 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:37.946313 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:37.948287 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:37.949500 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:37.986779 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Getting quotas for project 7ae2d50102bf491986834edf07a6a868. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:16:37.995448 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Getting quotas for user 1181f7a15e6d4732865fe02f985bf189 and project 7ae2d50102bf491986834edf07a6a868. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:16:38.093341 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Going to run 1 instances... {{(pid=116303) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:16:38.096009 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='85265789-1a65-490a-aafb-4b404cb0bcb2',volume_size=None,volume_type=None)] {{(pid=116303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:16:38.261589 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8a1a6e5f-2fe0-442e-9480-8ef93b9fe619 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.006442 Nov 24 16:16:38.262782 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 597/1173] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:16:37 2021] POST /compute/v2.1/servers => generated 405 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:16:38.275569 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-4af30676-e462-48af-9f1e-e918eec6a4ce tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:38.276689 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-4af30676-e462-48af-9f1e-e918eec6a4ce tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:38.333587 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-4af30676-e462-48af-9f1e-e918eec6a4ce tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:38.344023 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-4af30676-e462-48af-9f1e-e918eec6a4ce tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1094 microversion: 2.1 time: 0.074589 Nov 24 16:16:38.344901 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 577/1174] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:38 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:39.363762 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-bf125832-4fc3-4130-b9e9-95e677e88c1d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:39.364460 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-bf125832-4fc3-4130-b9e9-95e677e88c1d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:39.372983 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bf125832-4fc3-4130-b9e9-95e677e88c1d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:39.373569 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bf125832-4fc3-4130-b9e9-95e677e88c1d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:39.374455 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bf125832-4fc3-4130-b9e9-95e677e88c1d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:39.374951 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-bf125832-4fc3-4130-b9e9-95e677e88c1d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:39.440460 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-bf125832-4fc3-4130-b9e9-95e677e88c1d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:39.448725 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-bf125832-4fc3-4130-b9e9-95e677e88c1d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1210 microversion: 2.1 time: 0.090316 Nov 24 16:16:39.449764 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 598/1175] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:39 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:40.471197 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-06f835f0-6911-4613-aef4-100681404f8b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:40.473093 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-06f835f0-6911-4613-aef4-100681404f8b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:40.485116 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-06f835f0-6911-4613-aef4-100681404f8b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:40.486188 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-06f835f0-6911-4613-aef4-100681404f8b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:40.488186 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-06f835f0-6911-4613-aef4-100681404f8b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:40.489362 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-06f835f0-6911-4613-aef4-100681404f8b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:40.733689 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-06f835f0-6911-4613-aef4-100681404f8b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:40.741383 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-06f835f0-6911-4613-aef4-100681404f8b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1265 microversion: 2.1 time: 0.277922 Nov 24 16:16:40.742724 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 578/1176] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:40 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:41.091816 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-f7460f90-178c-4fb5-a412-823c0ede3926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2843917b-11a2-42d7-bf56-f60e26980b1f", "tag": "d9123976-7ebf-4103-a11c-67a75901f6c9"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:16:41.095017 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:16:41.095017 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:16:41.114658 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-f7460f90-178c-4fb5-a412-823c0ede3926 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:41.115365 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-f7460f90-178c-4fb5-a412-823c0ede3926 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:41.128655 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-f7460f90-178c-4fb5-a412-823c0ede3926 service nova] Creating event network-changed:d9123976-7ebf-4103-a11c-67a75901f6c9 for instance 2843917b-11a2-42d7-bf56-f60e26980b1f on hv-cinder-81899 Nov 24 16:16:41.134783 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-9f60c317-4db3-4e1e-ad0c-0565817779fe req-f7460f90-178c-4fb5-a412-823c0ede3926 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051096 Nov 24 16:16:41.135439 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 599/1177] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:16:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:16:41.770538 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-efb6ea51-3b49-405e-9b1b-e54a035aeef9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:41.771161 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-efb6ea51-3b49-405e-9b1b-e54a035aeef9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:41.780306 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-efb6ea51-3b49-405e-9b1b-e54a035aeef9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:41.780754 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-efb6ea51-3b49-405e-9b1b-e54a035aeef9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:41.781598 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-efb6ea51-3b49-405e-9b1b-e54a035aeef9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:41.782027 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-efb6ea51-3b49-405e-9b1b-e54a035aeef9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:42.060680 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-efb6ea51-3b49-405e-9b1b-e54a035aeef9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:42.073599 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-efb6ea51-3b49-405e-9b1b-e54a035aeef9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1265 microversion: 2.1 time: 0.310123 Nov 24 16:16:42.074200 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 579/1178] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:41 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:43.096904 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9fb09bfb-1af6-4727-b8a2-d6435442106b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:43.097638 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9fb09bfb-1af6-4727-b8a2-d6435442106b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:43.104805 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9fb09bfb-1af6-4727-b8a2-d6435442106b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:43.105303 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9fb09bfb-1af6-4727-b8a2-d6435442106b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:43.106092 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9fb09bfb-1af6-4727-b8a2-d6435442106b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:43.106528 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9fb09bfb-1af6-4727-b8a2-d6435442106b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:43.268127 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9fb09bfb-1af6-4727-b8a2-d6435442106b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:43.276405 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9fb09bfb-1af6-4727-b8a2-d6435442106b tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1265 microversion: 2.1 time: 0.183950 Nov 24 16:16:43.276998 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 600/1179] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:43 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:44.294403 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-73aab23e-2a3f-4fa2-b0b8-bffb36dc116c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:44.295001 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-73aab23e-2a3f-4fa2-b0b8-bffb36dc116c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:44.301630 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73aab23e-2a3f-4fa2-b0b8-bffb36dc116c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:44.302073 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73aab23e-2a3f-4fa2-b0b8-bffb36dc116c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:44.302857 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73aab23e-2a3f-4fa2-b0b8-bffb36dc116c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:44.303290 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73aab23e-2a3f-4fa2-b0b8-bffb36dc116c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:44.455310 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-73aab23e-2a3f-4fa2-b0b8-bffb36dc116c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:44.463671 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-73aab23e-2a3f-4fa2-b0b8-bffb36dc116c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1265 microversion: 2.1 time: 0.173277 Nov 24 16:16:44.464268 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 580/1180] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:44 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:45.481904 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-80b1c2c5-c454-40c7-b51e-5178c984149f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:45.482544 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-80b1c2c5-c454-40c7-b51e-5178c984149f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:45.488836 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-80b1c2c5-c454-40c7-b51e-5178c984149f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:45.489315 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-80b1c2c5-c454-40c7-b51e-5178c984149f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:45.490096 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-80b1c2c5-c454-40c7-b51e-5178c984149f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:45.490537 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-80b1c2c5-c454-40c7-b51e-5178c984149f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:45.637695 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-80b1c2c5-c454-40c7-b51e-5178c984149f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:45.645116 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-80b1c2c5-c454-40c7-b51e-5178c984149f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1265 microversion: 2.1 time: 0.167001 Nov 24 16:16:45.645685 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 601/1181] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:45 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:46.661975 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-28477e94-ad79-4687-878c-bcda4c79e38f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:46.662662 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-28477e94-ad79-4687-878c-bcda4c79e38f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:46.669773 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-28477e94-ad79-4687-878c-bcda4c79e38f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:46.670228 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-28477e94-ad79-4687-878c-bcda4c79e38f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:46.671168 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-28477e94-ad79-4687-878c-bcda4c79e38f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:46.671609 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-28477e94-ad79-4687-878c-bcda4c79e38f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:46.805716 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-28477e94-ad79-4687-878c-bcda4c79e38f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:46.813072 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-28477e94-ad79-4687-878c-bcda4c79e38f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1265 microversion: 2.1 time: 0.154908 Nov 24 16:16:46.813638 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 581/1182] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:46 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:47.830442 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7e140715-f7a9-440b-b5db-fb6314d91bbe tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:47.831170 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7e140715-f7a9-440b-b5db-fb6314d91bbe tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:47.837577 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7e140715-f7a9-440b-b5db-fb6314d91bbe tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:47.838020 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7e140715-f7a9-440b-b5db-fb6314d91bbe tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:47.838788 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7e140715-f7a9-440b-b5db-fb6314d91bbe tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:47.839215 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7e140715-f7a9-440b-b5db-fb6314d91bbe tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:47.977180 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7e140715-f7a9-440b-b5db-fb6314d91bbe tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:47.984483 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7e140715-f7a9-440b-b5db-fb6314d91bbe tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1265 microversion: 2.1 time: 0.157808 Nov 24 16:16:47.985088 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 602/1183] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:47 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:49.001753 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-49e24641-15a9-470d-b44a-ba4617558feb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:49.002400 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-49e24641-15a9-470d-b44a-ba4617558feb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:49.009486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49e24641-15a9-470d-b44a-ba4617558feb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:49.009944 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49e24641-15a9-470d-b44a-ba4617558feb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:49.010729 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49e24641-15a9-470d-b44a-ba4617558feb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:49.011169 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-49e24641-15a9-470d-b44a-ba4617558feb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:49.146972 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-49e24641-15a9-470d-b44a-ba4617558feb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:49.155235 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-49e24641-15a9-470d-b44a-ba4617558feb tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1265 microversion: 2.1 time: 0.157170 Nov 24 16:16:49.155811 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 582/1184] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:48 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:50.172612 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9d5140ca-cdf2-4982-8daf-204b80a5d579 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:50.173255 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9d5140ca-cdf2-4982-8daf-204b80a5d579 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:50.179835 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9d5140ca-cdf2-4982-8daf-204b80a5d579 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:50.180307 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9d5140ca-cdf2-4982-8daf-204b80a5d579 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:50.181157 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9d5140ca-cdf2-4982-8daf-204b80a5d579 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:50.181591 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9d5140ca-cdf2-4982-8daf-204b80a5d579 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:50.320724 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9d5140ca-cdf2-4982-8daf-204b80a5d579 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:50.329402 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9d5140ca-cdf2-4982-8daf-204b80a5d579 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1265 microversion: 2.1 time: 0.160398 Nov 24 16:16:50.329993 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 603/1185] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:50 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:51.346486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-029776a7-ed17-47c1-abda-beda4cbf2034 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:51.347093 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-029776a7-ed17-47c1-abda-beda4cbf2034 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:51.354255 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-029776a7-ed17-47c1-abda-beda4cbf2034 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:51.354708 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-029776a7-ed17-47c1-abda-beda4cbf2034 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:51.355495 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-029776a7-ed17-47c1-abda-beda4cbf2034 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:51.355938 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-029776a7-ed17-47c1-abda-beda4cbf2034 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:51.502393 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-029776a7-ed17-47c1-abda-beda4cbf2034 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:51.510630 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-029776a7-ed17-47c1-abda-beda4cbf2034 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1265 microversion: 2.1 time: 0.168137 Nov 24 16:16:51.511199 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 583/1186] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:51 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:52.282975 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-ef5ce5a8-fda5-47cf-98d7-e785ffa36227 req-278176df-5433-4ac4-bbc3-f54f73a3e517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2843917b-11a2-42d7-bf56-f60e26980b1f", "name": "network-vif-plugged", "status": "completed", "tag": "d9123976-7ebf-4103-a11c-67a75901f6c9"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:16:52.284492 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:16:52.284492 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:16:52.292603 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-ef5ce5a8-fda5-47cf-98d7-e785ffa36227 req-278176df-5433-4ac4-bbc3-f54f73a3e517 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:52.293057 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-ef5ce5a8-fda5-47cf-98d7-e785ffa36227 req-278176df-5433-4ac4-bbc3-f54f73a3e517 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:52.304092 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-ef5ce5a8-fda5-47cf-98d7-e785ffa36227 req-278176df-5433-4ac4-bbc3-f54f73a3e517 service nova] Creating event network-vif-plugged:d9123976-7ebf-4103-a11c-67a75901f6c9 for instance 2843917b-11a2-42d7-bf56-f60e26980b1f on hv-cinder-81899 Nov 24 16:16:52.309512 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-ef5ce5a8-fda5-47cf-98d7-e785ffa36227 req-278176df-5433-4ac4-bbc3-f54f73a3e517 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030179 Nov 24 16:16:52.310185 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 604/1187] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:16:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:16:52.527983 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-23e59b01-92bb-4717-930e-03e1d80a64f7 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:52.528581 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-23e59b01-92bb-4717-930e-03e1d80a64f7 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:52.534886 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23e59b01-92bb-4717-930e-03e1d80a64f7 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:52.535339 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23e59b01-92bb-4717-930e-03e1d80a64f7 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:52.536129 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23e59b01-92bb-4717-930e-03e1d80a64f7 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:52.536570 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23e59b01-92bb-4717-930e-03e1d80a64f7 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:52.695900 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-23e59b01-92bb-4717-930e-03e1d80a64f7 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:52.703285 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-23e59b01-92bb-4717-930e-03e1d80a64f7 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1265 microversion: 2.1 time: 0.179058 Nov 24 16:16:52.703852 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 584/1188] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:52 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:53.722727 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-89d2d605-48d2-4873-9ea2-7042110a0566 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:53.723340 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-89d2d605-48d2-4873-9ea2-7042110a0566 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:53.730165 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-89d2d605-48d2-4873-9ea2-7042110a0566 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:53.730614 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-89d2d605-48d2-4873-9ea2-7042110a0566 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:53.731394 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-89d2d605-48d2-4873-9ea2-7042110a0566 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:53.731833 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-89d2d605-48d2-4873-9ea2-7042110a0566 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:53.871555 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-89d2d605-48d2-4873-9ea2-7042110a0566 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:53.879595 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-89d2d605-48d2-4873-9ea2-7042110a0566 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1265 microversion: 2.1 time: 0.162333 Nov 24 16:16:53.880164 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 605/1189] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:53 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:54.895713 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-3efe8239-8b9c-4206-8304-65462316d48f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:54.896268 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-3efe8239-8b9c-4206-8304-65462316d48f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:54.903466 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3efe8239-8b9c-4206-8304-65462316d48f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:54.903915 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3efe8239-8b9c-4206-8304-65462316d48f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:54.904723 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3efe8239-8b9c-4206-8304-65462316d48f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:54.905193 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-3efe8239-8b9c-4206-8304-65462316d48f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:55.036363 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-3efe8239-8b9c-4206-8304-65462316d48f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:55.044468 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-3efe8239-8b9c-4206-8304-65462316d48f tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1452 microversion: 2.1 time: 0.152643 Nov 24 16:16:55.045056 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 585/1190] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:54 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:55.060056 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f2d6654c-6c69-4b0e-8335-86983c420ad0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:16:55.060656 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f2d6654c-6c69-4b0e-8335-86983c420ad0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:55.066920 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f2d6654c-6c69-4b0e-8335-86983c420ad0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:55.067362 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f2d6654c-6c69-4b0e-8335-86983c420ad0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:55.068133 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f2d6654c-6c69-4b0e-8335-86983c420ad0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:55.068560 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f2d6654c-6c69-4b0e-8335-86983c420ad0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:55.205205 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-f2d6654c-6c69-4b0e-8335-86983c420ad0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:16:55.212643 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f2d6654c-6c69-4b0e-8335-86983c420ad0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1452 microversion: 2.1 time: 0.156135 Nov 24 16:16:55.213246 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 606/1191] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:16:55 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:16:55.709085 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:16:55.709306 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: Wed Nov 24 16:16:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:16:57.156923 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-e7ef8109-7ff5-44c3-9a7c-19234b82a8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2843917b-11a2-42d7-bf56-f60e26980b1f", "tag": "d9123976-7ebf-4103-a11c-67a75901f6c9"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:16:57.158509 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:16:57.158509 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:16:57.167025 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-e7ef8109-7ff5-44c3-9a7c-19234b82a8d5 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:57.167464 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-e7ef8109-7ff5-44c3-9a7c-19234b82a8d5 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:57.178792 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-e7ef8109-7ff5-44c3-9a7c-19234b82a8d5 service nova] Creating event network-changed:d9123976-7ebf-4103-a11c-67a75901f6c9 for instance 2843917b-11a2-42d7-bf56-f60e26980b1f on hv-cinder-81899 Nov 24 16:16:57.184977 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-88a4f475-1678-4f7e-bb17-9aad926953f4 req-e7ef8109-7ff5-44c3-9a7c-19234b82a8d5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031619 Nov 24 16:16:57.185906 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 586/1192] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:16:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:16:58.749069 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-eb3af2c1-aaa3-48b2-9b5d-a54f719cfa5e tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19a181c7-0e75-4d5c-92ad-79c3b783dfad", "device": "/dev/sdb"}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:16:58.750621 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-eb3af2c1-aaa3-48b2-9b5d-a54f719cfa5e tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:16:58.757684 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-eb3af2c1-aaa3-48b2-9b5d-a54f719cfa5e tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:58.758135 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-eb3af2c1-aaa3-48b2-9b5d-a54f719cfa5e tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:58.758917 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-eb3af2c1-aaa3-48b2-9b5d-a54f719cfa5e tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:16:58.759350 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-eb3af2c1-aaa3-48b2-9b5d-a54f719cfa5e tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:16:58.998859 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-eb3af2c1-aaa3-48b2-9b5d-a54f719cfa5e tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "POST /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253680 Nov 24 16:16:58.999553 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 607/1193] 10.222.0.72 () {60 vars in 1322 bytes} [Wed Nov 24 16:16:58 2021] POST /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:16:59.505267 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:16:59.505887 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: Wed Nov 24 16:16:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:17:25.608991 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f71ea6e5-fb31-4f03-a043-a3ed7be11aaa tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:25.609706 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f71ea6e5-fb31-4f03-a043-a3ed7be11aaa tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:25.616562 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f71ea6e5-fb31-4f03-a043-a3ed7be11aaa tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:25.617133 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f71ea6e5-fb31-4f03-a043-a3ed7be11aaa tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:25.618544 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f71ea6e5-fb31-4f03-a043-a3ed7be11aaa tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:25.619035 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f71ea6e5-fb31-4f03-a043-a3ed7be11aaa tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:25.700709 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.objects.instance [None req-f71ea6e5-fb31-4f03-a043-a3ed7be11aaa tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lazy-loading 'services' on Instance uuid 7affc9c3-2c9c-4b32-91fc-e3a189845148 {{(pid=116304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:17:25.772488 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f71ea6e5-fb31-4f03-a043-a3ed7be11aaa tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148/os-volume_attachments/19a181c7-0e75-4d5c-92ad-79c3b783dfad" status: 202 len: 0 microversion: 2.1 time: 0.167502 Nov 24 16:17:25.773460 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 587/1194] 10.222.0.72 () {58 vars in 1415 bytes} [Wed Nov 24 16:17:25 2021] DELETE /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148/os-volume_attachments/19a181c7-0e75-4d5c-92ad-79c3b783dfad => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:17:26.883125 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:26.883772 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:26.889839 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:26.890280 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:26.891047 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:26.891471 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:26.915716 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Going to try to terminate instance {{(pid=116303) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:17:26.989985 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1a0e023d-864d-4b26-b8a0-c77910cbbe77 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 204 len: 0 microversion: 2.1 time: 0.111614 Nov 24 16:17:26.990840 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 608/1195] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:17:26 2021] DELETE /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:17:27.001433 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7a23385c-56ac-48ae-97cf-9b52dccd6b66 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:27.002325 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7a23385c-56ac-48ae-97cf-9b52dccd6b66 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:27.009101 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a23385c-56ac-48ae-97cf-9b52dccd6b66 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:27.009553 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a23385c-56ac-48ae-97cf-9b52dccd6b66 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:27.010348 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a23385c-56ac-48ae-97cf-9b52dccd6b66 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:27.010783 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7a23385c-56ac-48ae-97cf-9b52dccd6b66 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:27.146302 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7a23385c-56ac-48ae-97cf-9b52dccd6b66 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:17:27.153993 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7a23385c-56ac-48ae-97cf-9b52dccd6b66 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1514 microversion: 2.1 time: 0.158670 Nov 24 16:17:27.154549 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 588/1196] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:17:26 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:17:28.171661 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3b696723-2e5f-4a02-b0db-aedd9e6f432b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:28.172356 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3b696723-2e5f-4a02-b0db-aedd9e6f432b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:28.178903 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3b696723-2e5f-4a02-b0db-aedd9e6f432b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:28.179337 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3b696723-2e5f-4a02-b0db-aedd9e6f432b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:28.180119 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3b696723-2e5f-4a02-b0db-aedd9e6f432b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:28.180546 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3b696723-2e5f-4a02-b0db-aedd9e6f432b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:28.330991 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3b696723-2e5f-4a02-b0db-aedd9e6f432b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:17:28.338968 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3b696723-2e5f-4a02-b0db-aedd9e6f432b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1514 microversion: 2.1 time: 0.171355 Nov 24 16:17:28.339536 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 609/1197] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:17:28 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:17:29.356362 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7e8d3b00-a143-4481-9693-4c25045edce1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:29.356930 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7e8d3b00-a143-4481-9693-4c25045edce1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:29.362998 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e8d3b00-a143-4481-9693-4c25045edce1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:29.363446 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e8d3b00-a143-4481-9693-4c25045edce1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:29.364231 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e8d3b00-a143-4481-9693-4c25045edce1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:29.364666 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e8d3b00-a143-4481-9693-4c25045edce1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:29.436200 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7e8d3b00-a143-4481-9693-4c25045edce1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:17:29.444193 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7e8d3b00-a143-4481-9693-4c25045edce1 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 200 len: 1472 microversion: 2.1 time: 0.091398 Nov 24 16:17:29.445369 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 589/1198] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:17:29 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 1472 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:17:29.521833 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-ec183590-e6ff-4e50-9e83-7e8a7babd233 req-27d7c08c-82ed-4e07-9dfd-e2f0bed29ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7affc9c3-2c9c-4b32-91fc-e3a189845148", "name": "network-vif-deleted", "tag": "0adfe968-26c2-481a-8821-0e1906cc8f14"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:17:29.524492 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:17:29.524492 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:17:29.532510 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-ec183590-e6ff-4e50-9e83-7e8a7babd233 req-27d7c08c-82ed-4e07-9dfd-e2f0bed29ec0 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:29.532950 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-ec183590-e6ff-4e50-9e83-7e8a7babd233 req-27d7c08c-82ed-4e07-9dfd-e2f0bed29ec0 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:29.545958 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-ec183590-e6ff-4e50-9e83-7e8a7babd233 req-27d7c08c-82ed-4e07-9dfd-e2f0bed29ec0 service nova] Creating event network-vif-deleted:0adfe968-26c2-481a-8821-0e1906cc8f14 for instance 7affc9c3-2c9c-4b32-91fc-e3a189845148 on hv-cinder-81899 Nov 24 16:17:29.551142 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-ec183590-e6ff-4e50-9e83-7e8a7babd233 req-27d7c08c-82ed-4e07-9dfd-e2f0bed29ec0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032858 Nov 24 16:17:29.552044 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 610/1199] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:17:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:17:30.462087 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-73d47461-4ca2-4f53-8657-8a30f47ea6e5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:30.462700 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-73d47461-4ca2-4f53-8657-8a30f47ea6e5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 7affc9c3-2c9c-4b32-91fc-e3a189845148] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:30.469094 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73d47461-4ca2-4f53-8657-8a30f47ea6e5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:30.469486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73d47461-4ca2-4f53-8657-8a30f47ea6e5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:30.470270 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73d47461-4ca2-4f53-8657-8a30f47ea6e5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:30.470740 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-73d47461-4ca2-4f53-8657-8a30f47ea6e5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:30.484624 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-73d47461-4ca2-4f53-8657-8a30f47ea6e5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] HTTP exception thrown: Instance 7affc9c3-2c9c-4b32-91fc-e3a189845148 could not be found. Nov 24 16:17:30.485257 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-73d47461-4ca2-4f53-8657-8a30f47ea6e5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Returning 404 to user: Instance 7affc9c3-2c9c-4b32-91fc-e3a189845148 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:17:30.486066 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-73d47461-4ca2-4f53-8657-8a30f47ea6e5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148" status: 404 len: 111 microversion: 2.1 time: 0.028426 Nov 24 16:17:30.486604 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 590/1200] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:17:30 2021] GET /compute/v2.1/servers/7affc9c3-2c9c-4b32-91fc-e3a189845148 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:17:41.282457 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2066949873", "imageRef": "ad8c1333-b685-44be-8c3d-e0be0b1544a5", "flavorRef": "452", "networks": [{"uuid": "8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2"}]}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:17:41.332972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.network.neutron [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] validate_networks() for [('8ccb9f93-e7b7-4122-8c0e-e3d4d2798bb2', None, None, None, None, None)] {{(pid=116303) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:17:41.676486 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Flavor limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:17:41.676908 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Image limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:17:41.677427 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Flavor pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:17:41.677831 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Image pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:17:41.679073 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:17:41.687708 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:41.688151 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:41.688959 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:41.689417 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:41.706127 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Getting quotas for project 778d3476a1b6447c8b02c8eb73bfe48e. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:17:41.710368 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Getting quotas for user 6f22bc0e9e744d7f82784f76631f8d97 and project 778d3476a1b6447c8b02c8eb73bfe48e. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:17:41.720700 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Going to run 1 instances... {{(pid=116303) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:17:41.723122 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad8c1333-b685-44be-8c3d-e0be0b1544a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:17:41.771451 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-e91298c2-d694-49ce-953f-10642cba9005 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493414 Nov 24 16:17:41.772507 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 611/1201] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:17:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:17:41.782190 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-02c69fbf-957d-4739-b628-298e15eef6ce tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:41.782801 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-02c69fbf-957d-4739-b628-298e15eef6ce tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:41.837579 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-02c69fbf-957d-4739-b628-298e15eef6ce tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:17:41.844060 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-02c69fbf-957d-4739-b628-298e15eef6ce tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66" status: 200 len: 1219 microversion: 2.1 time: 0.065572 Nov 24 16:17:41.848022 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 591/1202] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:17:41 2021] GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:17:42.862795 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-22e91181-f30c-4c6b-a784-bfaf1bb34030 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:42.863408 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-22e91181-f30c-4c6b-a784-bfaf1bb34030 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:42.871780 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-22e91181-f30c-4c6b-a784-bfaf1bb34030 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:42.872222 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-22e91181-f30c-4c6b-a784-bfaf1bb34030 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:42.873332 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-22e91181-f30c-4c6b-a784-bfaf1bb34030 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:42.873763 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-22e91181-f30c-4c6b-a784-bfaf1bb34030 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:42.942283 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-22e91181-f30c-4c6b-a784-bfaf1bb34030 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:17:42.951394 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-22e91181-f30c-4c6b-a784-bfaf1bb34030 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66" status: 200 len: 1277 microversion: 2.1 time: 0.093178 Nov 24 16:17:42.951631 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 612/1203] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:17:42 2021] GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66 => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:17:43.970952 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0324171d-3c0a-4325-8dab-77071fc8175b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:43.971607 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0324171d-3c0a-4325-8dab-77071fc8175b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:43.979225 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0324171d-3c0a-4325-8dab-77071fc8175b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:43.979680 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0324171d-3c0a-4325-8dab-77071fc8175b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:43.980486 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0324171d-3c0a-4325-8dab-77071fc8175b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:43.980925 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0324171d-3c0a-4325-8dab-77071fc8175b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:44.084859 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-f50ad79f-70b3-44a0-b1f2-2afe24bd97de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f2fe97a-bc77-447c-beeb-38569a4f8a66", "tag": "1ef0e071-bd08-48a0-80e3-0219af8862be"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:17:44.086912 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:17:44.086912 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:17:44.095057 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-f50ad79f-70b3-44a0-b1f2-2afe24bd97de service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:44.095950 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-f50ad79f-70b3-44a0-b1f2-2afe24bd97de service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:44.107874 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-f50ad79f-70b3-44a0-b1f2-2afe24bd97de service nova] Creating event network-changed:1ef0e071-bd08-48a0-80e3-0219af8862be for instance 3f2fe97a-bc77-447c-beeb-38569a4f8a66 on hv-cinder-81899 Nov 24 16:17:44.113135 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-fc3a98e3-ec0d-4475-9cac-e52d29279fd1 req-f50ad79f-70b3-44a0-b1f2-2afe24bd97de service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032189 Nov 24 16:17:44.113741 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 613/1204] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:17:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:17:44.219470 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0324171d-3c0a-4325-8dab-77071fc8175b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:17:44.227312 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0324171d-3c0a-4325-8dab-77071fc8175b tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66" status: 200 len: 1319 microversion: 2.1 time: 0.260162 Nov 24 16:17:44.227883 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 592/1205] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:17:43 2021] GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:17:45.244585 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b1b5680f-869b-410e-8334-93ca919ff5c7 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:45.245302 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b1b5680f-869b-410e-8334-93ca919ff5c7 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:45.251614 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b1b5680f-869b-410e-8334-93ca919ff5c7 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:45.252053 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b1b5680f-869b-410e-8334-93ca919ff5c7 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:45.252813 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b1b5680f-869b-410e-8334-93ca919ff5c7 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:45.253262 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b1b5680f-869b-410e-8334-93ca919ff5c7 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:45.390169 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-b1b5680f-869b-410e-8334-93ca919ff5c7 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:17:45.398089 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b1b5680f-869b-410e-8334-93ca919ff5c7 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66" status: 200 len: 1319 microversion: 2.1 time: 0.158106 Nov 24 16:17:45.398666 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 614/1206] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:17:45 2021] GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:17:46.415226 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b03ef702-0587-4a26-9421-666d0c1396f5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:46.415842 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b03ef702-0587-4a26-9421-666d0c1396f5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:46.422283 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b03ef702-0587-4a26-9421-666d0c1396f5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:46.422733 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b03ef702-0587-4a26-9421-666d0c1396f5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:46.423564 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b03ef702-0587-4a26-9421-666d0c1396f5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:46.424049 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b03ef702-0587-4a26-9421-666d0c1396f5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:46.558063 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b03ef702-0587-4a26-9421-666d0c1396f5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:17:46.565270 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b03ef702-0587-4a26-9421-666d0c1396f5 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66" status: 200 len: 1319 microversion: 2.1 time: 0.154461 Nov 24 16:17:46.565840 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 593/1207] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:17:46 2021] GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:17:47.582710 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4bce69c9-78dc-471c-a68c-cc6d76ccd5e3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:47.583268 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4bce69c9-78dc-471c-a68c-cc6d76ccd5e3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:47.590051 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4bce69c9-78dc-471c-a68c-cc6d76ccd5e3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:47.590504 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4bce69c9-78dc-471c-a68c-cc6d76ccd5e3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:47.591288 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4bce69c9-78dc-471c-a68c-cc6d76ccd5e3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:47.591724 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4bce69c9-78dc-471c-a68c-cc6d76ccd5e3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:47.726875 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4bce69c9-78dc-471c-a68c-cc6d76ccd5e3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:17:47.734303 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4bce69c9-78dc-471c-a68c-cc6d76ccd5e3 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66" status: 200 len: 1319 microversion: 2.1 time: 0.155434 Nov 24 16:17:47.734864 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 615/1208] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:17:47 2021] GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:17:48.751412 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-221b2d96-3f22-472a-baef-a05ea7d1b3ec tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:48.752053 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-221b2d96-3f22-472a-baef-a05ea7d1b3ec tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:48.759119 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-221b2d96-3f22-472a-baef-a05ea7d1b3ec tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:48.759572 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-221b2d96-3f22-472a-baef-a05ea7d1b3ec tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:48.760372 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-221b2d96-3f22-472a-baef-a05ea7d1b3ec tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:48.760813 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-221b2d96-3f22-472a-baef-a05ea7d1b3ec tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:48.894967 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-221b2d96-3f22-472a-baef-a05ea7d1b3ec tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:17:48.903258 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-221b2d96-3f22-472a-baef-a05ea7d1b3ec tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66" status: 200 len: 1319 microversion: 2.1 time: 0.155792 Nov 24 16:17:48.904057 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 594/1209] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:17:48 2021] GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:17:48.987302 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-c015d3eb-93f7-424b-ba48-1de703878680 req-cce0d7eb-deb4-4d35-b026-3866a267de1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f2fe97a-bc77-447c-beeb-38569a4f8a66", "name": "network-vif-plugged", "status": "completed", "tag": "1ef0e071-bd08-48a0-80e3-0219af8862be"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:17:48.988819 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:17:48.988819 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:17:48.995698 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-c015d3eb-93f7-424b-ba48-1de703878680 req-cce0d7eb-deb4-4d35-b026-3866a267de1d service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:48.996132 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-c015d3eb-93f7-424b-ba48-1de703878680 req-cce0d7eb-deb4-4d35-b026-3866a267de1d service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:49.006706 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-c015d3eb-93f7-424b-ba48-1de703878680 req-cce0d7eb-deb4-4d35-b026-3866a267de1d service nova] Creating event network-vif-plugged:1ef0e071-bd08-48a0-80e3-0219af8862be for instance 3f2fe97a-bc77-447c-beeb-38569a4f8a66 on hv-cinder-81899 Nov 24 16:17:49.011908 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-c015d3eb-93f7-424b-ba48-1de703878680 req-cce0d7eb-deb4-4d35-b026-3866a267de1d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159072 Nov 24 16:17:49.012616 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 616/1210] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:17:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:17:49.920506 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ae8a06f5-a4ed-4373-b3d8-df7d255dc8b4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:49.921159 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ae8a06f5-a4ed-4373-b3d8-df7d255dc8b4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:49.927362 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ae8a06f5-a4ed-4373-b3d8-df7d255dc8b4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:49.928318 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ae8a06f5-a4ed-4373-b3d8-df7d255dc8b4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:49.929114 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ae8a06f5-a4ed-4373-b3d8-df7d255dc8b4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:49.929547 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ae8a06f5-a4ed-4373-b3d8-df7d255dc8b4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:50.057538 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ae8a06f5-a4ed-4373-b3d8-df7d255dc8b4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:17:50.064747 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ae8a06f5-a4ed-4373-b3d8-df7d255dc8b4 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66" status: 200 len: 1319 microversion: 2.1 time: 0.147869 Nov 24 16:17:50.065355 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 595/1211] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:17:49 2021] GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:17:51.082364 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-34e69aac-1271-4a3c-a262-ecd3c074de09 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:17:51.083056 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-34e69aac-1271-4a3c-a262-ecd3c074de09 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:51.090268 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-34e69aac-1271-4a3c-a262-ecd3c074de09 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:51.090716 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-34e69aac-1271-4a3c-a262-ecd3c074de09 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:51.091497 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-34e69aac-1271-4a3c-a262-ecd3c074de09 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:51.091933 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-34e69aac-1271-4a3c-a262-ecd3c074de09 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:51.224162 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-34e69aac-1271-4a3c-a262-ecd3c074de09 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:17:51.231821 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-34e69aac-1271-4a3c-a262-ecd3c074de09 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66" status: 200 len: 1509 microversion: 2.1 time: 0.153536 Nov 24 16:17:51.232385 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 617/1212] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:17:51 2021] GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:17:51.248546 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-66157eb1-e78d-4283-ad0e-4b2dd0502a54 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3f1dc80-da6d-4796-a05c-12e1d09930dd", "device": "/dev/sdb"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:17:51.250209 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-66157eb1-e78d-4283-ad0e-4b2dd0502a54 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:17:51.257126 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66157eb1-e78d-4283-ad0e-4b2dd0502a54 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:51.257612 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66157eb1-e78d-4283-ad0e-4b2dd0502a54 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:51.258483 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66157eb1-e78d-4283-ad0e-4b2dd0502a54 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:17:51.258828 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-66157eb1-e78d-4283-ad0e-4b2dd0502a54 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:17:51.499108 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-66157eb1-e78d-4283-ad0e-4b2dd0502a54 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "POST /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254335 Nov 24 16:17:51.499735 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 596/1213] 10.222.0.72 () {60 vars in 1322 bytes} [Wed Nov 24 16:17:51 2021] POST /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:18:12.776009 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c82d66cf-5784-4df1-8ff5-00caa0acd835 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:18:12.776554 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c82d66cf-5784-4df1-8ff5-00caa0acd835 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:18:12.782563 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c82d66cf-5784-4df1-8ff5-00caa0acd835 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:18:12.783012 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c82d66cf-5784-4df1-8ff5-00caa0acd835 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:18:12.783789 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c82d66cf-5784-4df1-8ff5-00caa0acd835 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:18:12.784224 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c82d66cf-5784-4df1-8ff5-00caa0acd835 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:18:12.862198 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.objects.instance [None req-c82d66cf-5784-4df1-8ff5-00caa0acd835 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lazy-loading 'services' on Instance uuid 3f2fe97a-bc77-447c-beeb-38569a4f8a66 {{(pid=116303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:18:12.932705 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c82d66cf-5784-4df1-8ff5-00caa0acd835 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66/os-volume_attachments/c3f1dc80-da6d-4796-a05c-12e1d09930dd" status: 202 len: 0 microversion: 2.1 time: 0.161140 Nov 24 16:18:12.933330 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 618/1214] 10.222.0.72 () {58 vars in 1415 bytes} [Wed Nov 24 16:18:12 2021] DELETE /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66/os-volume_attachments/c3f1dc80-da6d-4796-a05c-12e1d09930dd => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:18:14.039771 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:18:14.040365 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:18:14.046522 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:18:14.046970 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:18:14.047754 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:18:14.048191 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:18:14.073769 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:18:14.147805 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0a834f99-cc24-4aa4-a729-f7da9b86bf13 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66" status: 204 len: 0 microversion: 2.1 time: 0.112037 Nov 24 16:18:14.148540 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 597/1215] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:18:14 2021] DELETE /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:18:14.158192 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-46c1ab18-a42e-454d-9029-086b44649632 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:18:14.158890 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-46c1ab18-a42e-454d-9029-086b44649632 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:18:14.165547 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-46c1ab18-a42e-454d-9029-086b44649632 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:18:14.166001 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-46c1ab18-a42e-454d-9029-086b44649632 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:18:14.166777 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-46c1ab18-a42e-454d-9029-086b44649632 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:18:14.167406 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-46c1ab18-a42e-454d-9029-086b44649632 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:18:14.305845 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-46c1ab18-a42e-454d-9029-086b44649632 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:18:14.314749 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-46c1ab18-a42e-454d-9029-086b44649632 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66" status: 200 len: 1515 microversion: 2.1 time: 0.161285 Nov 24 16:18:14.315328 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 619/1216] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:18:14 2021] GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:18:15.333106 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-79d054db-7a6e-47d6-96bd-e9c8f36ee949 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:18:15.334234 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-79d054db-7a6e-47d6-96bd-e9c8f36ee949 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:18:15.340358 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79d054db-7a6e-47d6-96bd-e9c8f36ee949 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:18:15.340800 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79d054db-7a6e-47d6-96bd-e9c8f36ee949 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:18:15.341599 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79d054db-7a6e-47d6-96bd-e9c8f36ee949 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:18:15.342030 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-79d054db-7a6e-47d6-96bd-e9c8f36ee949 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:18:15.473863 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-79d054db-7a6e-47d6-96bd-e9c8f36ee949 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:18:15.482882 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-79d054db-7a6e-47d6-96bd-e9c8f36ee949 tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66" status: 200 len: 1515 microversion: 2.1 time: 0.153951 Nov 24 16:18:15.483465 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 598/1217] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:18:15 2021] GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:18:16.500767 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-02073e23-ab8c-417e-a921-bef3499d4d1a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:18:16.501354 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-02073e23-ab8c-417e-a921-bef3499d4d1a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:18:16.508097 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-02073e23-ab8c-417e-a921-bef3499d4d1a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:18:16.508552 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-02073e23-ab8c-417e-a921-bef3499d4d1a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:18:16.509400 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-02073e23-ab8c-417e-a921-bef3499d4d1a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:18:16.509852 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-02073e23-ab8c-417e-a921-bef3499d4d1a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:18:16.650153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-02073e23-ab8c-417e-a921-bef3499d4d1a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f22bc0e9e744d7f82784f76631f8d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d3476a1b6447c8b02c8eb73bfe48e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:18:16.658394 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-02073e23-ab8c-417e-a921-bef3499d4d1a tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66" status: 200 len: 1515 microversion: 2.1 time: 0.162376 Nov 24 16:18:16.658980 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 620/1218] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:18:16 2021] GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:18:16.989763 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-3829551d-78f1-4c75-888e-f6dffc854bd0 req-3ccd01ec-231e-4d1e-aa88-300babbacac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f2fe97a-bc77-447c-beeb-38569a4f8a66", "name": "network-vif-deleted", "tag": "1ef0e071-bd08-48a0-80e3-0219af8862be"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:18:16.991912 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:18:16.991912 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:18:17.000327 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-3829551d-78f1-4c75-888e-f6dffc854bd0 req-3ccd01ec-231e-4d1e-aa88-300babbacac4 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:18:17.000779 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-3829551d-78f1-4c75-888e-f6dffc854bd0 req-3ccd01ec-231e-4d1e-aa88-300babbacac4 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:18:17.012874 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-3829551d-78f1-4c75-888e-f6dffc854bd0 req-3ccd01ec-231e-4d1e-aa88-300babbacac4 service nova] Creating event network-vif-deleted:1ef0e071-bd08-48a0-80e3-0219af8862be for instance 3f2fe97a-bc77-447c-beeb-38569a4f8a66 on hv-cinder-81899 Nov 24 16:18:17.017780 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-3829551d-78f1-4c75-888e-f6dffc854bd0 req-3ccd01ec-231e-4d1e-aa88-300babbacac4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031638 Nov 24 16:18:17.018355 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 599/1219] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:18:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:18:17.678480 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0600c1d5-b015-47d3-936d-c47ec361d36f tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:18:17.679310 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0600c1d5-b015-47d3-936d-c47ec361d36f tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] [instance: 3f2fe97a-bc77-447c-beeb-38569a4f8a66] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:18:17.685410 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0600c1d5-b015-47d3-936d-c47ec361d36f tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:18:17.685865 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0600c1d5-b015-47d3-936d-c47ec361d36f tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:18:17.686643 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0600c1d5-b015-47d3-936d-c47ec361d36f tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:18:17.687080 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0600c1d5-b015-47d3-936d-c47ec361d36f tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:18:17.702880 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-0600c1d5-b015-47d3-936d-c47ec361d36f tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] HTTP exception thrown: Instance 3f2fe97a-bc77-447c-beeb-38569a4f8a66 could not be found. Nov 24 16:18:17.703466 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0600c1d5-b015-47d3-936d-c47ec361d36f tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] Returning 404 to user: Instance 3f2fe97a-bc77-447c-beeb-38569a4f8a66 could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:18:17.704287 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0600c1d5-b015-47d3-936d-c47ec361d36f tempest-VolumesSnapshotTestJSON-2000344837 tempest-VolumesSnapshotTestJSON-2000344837-project] 10.222.0.72 "GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66" status: 404 len: 111 microversion: 2.1 time: 0.029623 Nov 24 16:18:17.704825 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 621/1220] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:18:17 2021] GET /compute/v2.1/servers/3f2fe97a-bc77-447c-beeb-38569a4f8a66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:18:53.636002 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-86456196-6360-43d3-ac00-eaab2d3efde0 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Action: 'create', calling method: .version_select at 0x7f361faab3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2093989883"}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:18:53.650926 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-86456196-6360-43d3-ac00-eaab2d3efde0 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Getting quotas for project 0e05ec47caaa4b86ba407fd376f503c6. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:18:53.654884 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-86456196-6360-43d3-ac00-eaab2d3efde0 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Getting quotas for user 354362f62ea746ad94901a4fe5b65217 and project 0e05ec47caaa4b86ba407fd376f503c6. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:18:54.091268 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-86456196-6360-43d3-ac00-eaab2d3efde0 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Getting quotas for project 0e05ec47caaa4b86ba407fd376f503c6. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:18:54.094942 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-86456196-6360-43d3-ac00-eaab2d3efde0 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Getting quotas for user 354362f62ea746ad94901a4fe5b65217 and project 0e05ec47caaa4b86ba407fd376f503c6. Resources: {'key_pairs'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:18:54.107904 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-86456196-6360-43d3-ac00-eaab2d3efde0 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.668254 Nov 24 16:18:54.108493 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 600/1221] 10.222.0.72 () {60 vars in 1157 bytes} [Wed Nov 24 16:18:53 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:16.572703 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-172714370", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2093989883", "security_groups": [{"name": "tempest-secgroup-smoke-1740790247"}], "networks": [{"uuid": "7adfa203-bbb1-4530-a8be-f1ebfa6654ca"}], "block_device_mapping_v2": [{"uuid": "cf524bac-9ec8-4f5a-9bb6-18406d2f3e29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:19:16.680661 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.network.neutron [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] validate_networks() for [('7adfa203-bbb1-4530-a8be-f1ebfa6654ca', None, None, None, None, None)] {{(pid=116303) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:19:17.042402 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Flavor limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:19:17.042821 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Image limits 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:19:17.043290 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Flavor pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:19:17.043702 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Image pref 0:0:0 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:19:17.044290 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.virt.hardware [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:19:17.054276 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:17.054721 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:17.055542 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:17.055971 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:17.073945 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Getting quotas for project 0e05ec47caaa4b86ba407fd376f503c6. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:19:17.077972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.quota [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Getting quotas for user 354362f62ea746ad94901a4fe5b65217 and project 0e05ec47caaa4b86ba407fd376f503c6. Resources: {'cores', 'ram', 'instances'} {{(pid=116303) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:19:17.133698 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Going to run 1 instances... {{(pid=116303) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:19:17.135872 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cf524bac-9ec8-4f5a-9bb6-18406d2f3e29',volume_size=None,volume_type=None)] {{(pid=116303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:19:17.258891 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0ebeb6fb-109d-4aed-a248-18ddc91f0dc7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.690502 Nov 24 16:19:17.259560 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 622/1222] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:19:16 2021] POST /compute/v2.1/servers => generated 406 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:19:17.269796 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6c3d89b9-0797-4a8d-a192-d3981c82e396 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:17.270517 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6c3d89b9-0797-4a8d-a192-d3981c82e396 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:17.324849 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6c3d89b9-0797-4a8d-a192-d3981c82e396 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:17.331306 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6c3d89b9-0797-4a8d-a192-d3981c82e396 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1088 microversion: 2.1 time: 0.065637 Nov 24 16:19:17.331884 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 601/1223] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:17 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:18.348068 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-58c2296b-b484-4331-9af2-6c95988a26e7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:18.348899 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-58c2296b-b484-4331-9af2-6c95988a26e7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:18.355461 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-58c2296b-b484-4331-9af2-6c95988a26e7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:18.355907 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-58c2296b-b484-4331-9af2-6c95988a26e7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:18.357069 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-58c2296b-b484-4331-9af2-6c95988a26e7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:18.357199 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-58c2296b-b484-4331-9af2-6c95988a26e7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:18.419556 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-58c2296b-b484-4331-9af2-6c95988a26e7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:18.426913 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-58c2296b-b484-4331-9af2-6c95988a26e7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1204 microversion: 2.1 time: 0.083081 Nov 24 16:19:18.427486 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 623/1224] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:18 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1204 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:19.444398 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-88ddccc3-5b2a-4f20-bbb9-f52e1fb2556c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:19.445493 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-88ddccc3-5b2a-4f20-bbb9-f52e1fb2556c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:19.452281 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88ddccc3-5b2a-4f20-bbb9-f52e1fb2556c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:19.453136 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88ddccc3-5b2a-4f20-bbb9-f52e1fb2556c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:19.453999 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88ddccc3-5b2a-4f20-bbb9-f52e1fb2556c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:19.454793 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-88ddccc3-5b2a-4f20-bbb9-f52e1fb2556c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:19.555107 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-0be65d4f-8f8b-46ff-aba4-c365654199ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:19:19.558339 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:19:19.558339 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:19:19.585881 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-0be65d4f-8f8b-46ff-aba4-c365654199ca service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:19.586660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-0be65d4f-8f8b-46ff-aba4-c365654199ca service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:19.601307 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-0be65d4f-8f8b-46ff-aba4-c365654199ca service nova] Creating event network-changed:3762c609-4d3f-4e0f-a146-c0077e3c9f5c for instance 47ed20e5-f963-4489-aa73-4d9e4306db2b on hv-cinder-81899 Nov 24 16:19:19.607208 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-5e2def4f-ceac-4eae-9129-8f07130be7ab req-0be65d4f-8f8b-46ff-aba4-c365654199ca service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058682 Nov 24 16:19:19.607926 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 624/1225] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:19:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:19:19.679291 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-88ddccc3-5b2a-4f20-bbb9-f52e1fb2556c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:19.687596 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-88ddccc3-5b2a-4f20-bbb9-f52e1fb2556c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1260 microversion: 2.1 time: 0.247405 Nov 24 16:19:19.688026 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 602/1226] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:19 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:20.705312 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7f609c20-4797-4ea1-ae32-8c12547fdd35 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:20.705926 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7f609c20-4797-4ea1-ae32-8c12547fdd35 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:20.713797 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7f609c20-4797-4ea1-ae32-8c12547fdd35 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:20.714249 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7f609c20-4797-4ea1-ae32-8c12547fdd35 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:20.715033 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7f609c20-4797-4ea1-ae32-8c12547fdd35 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:20.715470 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7f609c20-4797-4ea1-ae32-8c12547fdd35 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:20.846268 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-7f609c20-4797-4ea1-ae32-8c12547fdd35 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:20.853531 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7f609c20-4797-4ea1-ae32-8c12547fdd35 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1260 microversion: 2.1 time: 0.152510 Nov 24 16:19:20.854099 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 625/1227] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:20 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:21.870343 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-0cc2da74-4508-47e3-a69b-2f898883b247 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:21.870899 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-0cc2da74-4508-47e3-a69b-2f898883b247 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:21.877387 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0cc2da74-4508-47e3-a69b-2f898883b247 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:21.877831 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0cc2da74-4508-47e3-a69b-2f898883b247 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:21.878599 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0cc2da74-4508-47e3-a69b-2f898883b247 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:21.879031 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-0cc2da74-4508-47e3-a69b-2f898883b247 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:22.013997 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-0cc2da74-4508-47e3-a69b-2f898883b247 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:22.021302 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-0cc2da74-4508-47e3-a69b-2f898883b247 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1260 microversion: 2.1 time: 0.154710 Nov 24 16:19:22.022510 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 603/1228] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:21 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:23.039443 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d2158631-fedd-4e5c-95a9-8b16266178d7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:23.040018 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d2158631-fedd-4e5c-95a9-8b16266178d7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:23.046516 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d2158631-fedd-4e5c-95a9-8b16266178d7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:23.046972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d2158631-fedd-4e5c-95a9-8b16266178d7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:23.047770 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d2158631-fedd-4e5c-95a9-8b16266178d7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:23.048209 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d2158631-fedd-4e5c-95a9-8b16266178d7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:23.187069 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d2158631-fedd-4e5c-95a9-8b16266178d7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:23.194968 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d2158631-fedd-4e5c-95a9-8b16266178d7 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1260 microversion: 2.1 time: 0.159895 Nov 24 16:19:23.195527 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 626/1229] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:23 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:24.211336 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6a386493-2d1e-4c34-94d0-877ef1ed73dc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:24.211924 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6a386493-2d1e-4c34-94d0-877ef1ed73dc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:24.218541 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6a386493-2d1e-4c34-94d0-877ef1ed73dc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:24.218993 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6a386493-2d1e-4c34-94d0-877ef1ed73dc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:24.219812 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6a386493-2d1e-4c34-94d0-877ef1ed73dc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:24.220323 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6a386493-2d1e-4c34-94d0-877ef1ed73dc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:24.352915 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6a386493-2d1e-4c34-94d0-877ef1ed73dc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:24.360463 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6a386493-2d1e-4c34-94d0-877ef1ed73dc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1260 microversion: 2.1 time: 0.153372 Nov 24 16:19:24.361045 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 604/1230] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:24 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:25.377857 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c4c3e740-df6e-4850-8b29-193316d51740 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:25.378409 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c4c3e740-df6e-4850-8b29-193316d51740 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:25.384874 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c4c3e740-df6e-4850-8b29-193316d51740 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:25.385349 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c4c3e740-df6e-4850-8b29-193316d51740 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:25.386125 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c4c3e740-df6e-4850-8b29-193316d51740 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:25.386553 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c4c3e740-df6e-4850-8b29-193316d51740 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:25.516722 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-c4c3e740-df6e-4850-8b29-193316d51740 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:25.524562 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c4c3e740-df6e-4850-8b29-193316d51740 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1260 microversion: 2.1 time: 0.150937 Nov 24 16:19:25.525445 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 627/1231] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:25 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:26.541156 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-7e14560b-8a07-49c9-ac58-cc2c9421104f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:26.541718 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-7e14560b-8a07-49c9-ac58-cc2c9421104f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:26.547897 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e14560b-8a07-49c9-ac58-cc2c9421104f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:26.548337 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e14560b-8a07-49c9-ac58-cc2c9421104f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:26.549120 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e14560b-8a07-49c9-ac58-cc2c9421104f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:26.549549 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-7e14560b-8a07-49c9-ac58-cc2c9421104f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:26.685567 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-7e14560b-8a07-49c9-ac58-cc2c9421104f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:26.692875 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-7e14560b-8a07-49c9-ac58-cc2c9421104f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1260 microversion: 2.1 time: 0.155552 Nov 24 16:19:26.693462 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 605/1232] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:26 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:27.709686 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-88fdc612-e65a-4267-b4fb-b7523226df40 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:27.710322 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-88fdc612-e65a-4267-b4fb-b7523226df40 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:27.716677 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88fdc612-e65a-4267-b4fb-b7523226df40 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:27.717165 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88fdc612-e65a-4267-b4fb-b7523226df40 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:27.717998 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88fdc612-e65a-4267-b4fb-b7523226df40 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:27.718429 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88fdc612-e65a-4267-b4fb-b7523226df40 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:27.858494 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-88fdc612-e65a-4267-b4fb-b7523226df40 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:27.866100 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-88fdc612-e65a-4267-b4fb-b7523226df40 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1260 microversion: 2.1 time: 0.160008 Nov 24 16:19:27.867322 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 628/1233] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:27 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:28.884449 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-380754b5-c5cc-435c-a6a2-d0599e8b178d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:28.885012 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-380754b5-c5cc-435c-a6a2-d0599e8b178d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:28.891321 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-380754b5-c5cc-435c-a6a2-d0599e8b178d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:28.891773 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-380754b5-c5cc-435c-a6a2-d0599e8b178d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:28.892555 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-380754b5-c5cc-435c-a6a2-d0599e8b178d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:28.892993 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-380754b5-c5cc-435c-a6a2-d0599e8b178d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:29.023576 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-380754b5-c5cc-435c-a6a2-d0599e8b178d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:29.030848 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-380754b5-c5cc-435c-a6a2-d0599e8b178d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1260 microversion: 2.1 time: 0.150750 Nov 24 16:19:29.031415 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 606/1234] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:28 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:29.290768 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-4c705598-a1f1-4e3e-b630-e1915ecbb48c req-1674f58f-0a8a-4cbe-9c74-aa1612abf867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "name": "network-vif-plugged", "status": "completed", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:19:29.292434 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:19:29.292434 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:19:29.300182 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-4c705598-a1f1-4e3e-b630-e1915ecbb48c req-1674f58f-0a8a-4cbe-9c74-aa1612abf867 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:29.300697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-4c705598-a1f1-4e3e-b630-e1915ecbb48c req-1674f58f-0a8a-4cbe-9c74-aa1612abf867 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:29.312337 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-4c705598-a1f1-4e3e-b630-e1915ecbb48c req-1674f58f-0a8a-4cbe-9c74-aa1612abf867 service nova] Creating event network-vif-plugged:3762c609-4d3f-4e0f-a146-c0077e3c9f5c for instance 47ed20e5-f963-4489-aa73-4d9e4306db2b on hv-cinder-81899 Nov 24 16:19:29.317500 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-4c705598-a1f1-4e3e-b630-e1915ecbb48c req-1674f58f-0a8a-4cbe-9c74-aa1612abf867 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030905 Nov 24 16:19:29.318094 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 629/1235] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:19:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:19:30.048716 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-de05d3e9-341e-4605-8d01-315fb972ea96 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:30.049482 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-de05d3e9-341e-4605-8d01-315fb972ea96 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:30.056343 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-de05d3e9-341e-4605-8d01-315fb972ea96 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:30.056794 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-de05d3e9-341e-4605-8d01-315fb972ea96 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:30.057622 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-de05d3e9-341e-4605-8d01-315fb972ea96 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:30.058057 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-de05d3e9-341e-4605-8d01-315fb972ea96 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:30.188336 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-de05d3e9-341e-4605-8d01-315fb972ea96 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:30.196574 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-de05d3e9-341e-4605-8d01-315fb972ea96 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1260 microversion: 2.1 time: 0.151446 Nov 24 16:19:30.197166 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 607/1236] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:30 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:31.215972 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6e3d2b9f-5707-490e-9fcc-51ea0d54197b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:31.216683 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6e3d2b9f-5707-490e-9fcc-51ea0d54197b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:31.223091 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6e3d2b9f-5707-490e-9fcc-51ea0d54197b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:31.223537 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6e3d2b9f-5707-490e-9fcc-51ea0d54197b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:31.224324 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6e3d2b9f-5707-490e-9fcc-51ea0d54197b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:31.224760 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6e3d2b9f-5707-490e-9fcc-51ea0d54197b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:31.358332 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6e3d2b9f-5707-490e-9fcc-51ea0d54197b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:31.365775 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6e3d2b9f-5707-490e-9fcc-51ea0d54197b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1444 microversion: 2.1 time: 0.155751 Nov 24 16:19:31.366341 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 630/1237] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:31 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:31.382696 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8a1f1cdb-61f4-4e72-84b7-429907011963 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:31.383352 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8a1f1cdb-61f4-4e72-84b7-429907011963 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:31.389578 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8a1f1cdb-61f4-4e72-84b7-429907011963 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:31.390025 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8a1f1cdb-61f4-4e72-84b7-429907011963 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:31.390798 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8a1f1cdb-61f4-4e72-84b7-429907011963 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:31.391231 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8a1f1cdb-61f4-4e72-84b7-429907011963 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:31.521944 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8a1f1cdb-61f4-4e72-84b7-429907011963 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:31.529885 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8a1f1cdb-61f4-4e72-84b7-429907011963 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1444 microversion: 2.1 time: 0.151330 Nov 24 16:19:31.530466 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 608/1238] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:31 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:33.451300 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-0a3399ae-c93b-43d6-a577-09f0df084be0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:19:33.452292 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:19:33.452292 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:19:33.459154 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-0a3399ae-c93b-43d6-a577-09f0df084be0 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:33.459593 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-0a3399ae-c93b-43d6-a577-09f0df084be0 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:33.471015 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-0a3399ae-c93b-43d6-a577-09f0df084be0 service nova] Creating event network-changed:3762c609-4d3f-4e0f-a146-c0077e3c9f5c for instance 47ed20e5-f963-4489-aa73-4d9e4306db2b on hv-cinder-81899 Nov 24 16:19:33.476192 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-0d4047ec-159b-4aa6-8d76-b16dddb0d388 req-0a3399ae-c93b-43d6-a577-09f0df084be0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031768 Nov 24 16:19:33.477115 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 631/1239] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:19:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:19:47.483073 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fff91bfc-63c8-449c-aa89-c98bb94ca257 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:47.483584 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fff91bfc-63c8-449c-aa89-c98bb94ca257 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:47.489634 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fff91bfc-63c8-449c-aa89-c98bb94ca257 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:47.490095 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fff91bfc-63c8-449c-aa89-c98bb94ca257 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:47.490880 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fff91bfc-63c8-449c-aa89-c98bb94ca257 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:47.492011 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fff91bfc-63c8-449c-aa89-c98bb94ca257 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:47.516898 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fff91bfc-63c8-449c-aa89-c98bb94ca257 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:19:47.592026 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fff91bfc-63c8-449c-aa89-c98bb94ca257 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 204 len: 0 microversion: 2.1 time: 0.112187 Nov 24 16:19:47.592730 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 609/1240] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:19:47 2021] DELETE /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:19:47.602659 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-90e267f7-8145-4212-bf93-d7eb2917480e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:47.603359 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-90e267f7-8145-4212-bf93-d7eb2917480e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:47.609871 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-90e267f7-8145-4212-bf93-d7eb2917480e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:47.610316 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-90e267f7-8145-4212-bf93-d7eb2917480e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:47.611098 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-90e267f7-8145-4212-bf93-d7eb2917480e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:47.611531 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-90e267f7-8145-4212-bf93-d7eb2917480e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:47.744915 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-90e267f7-8145-4212-bf93-d7eb2917480e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:47.752588 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-90e267f7-8145-4212-bf93-d7eb2917480e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1577 microversion: 2.1 time: 0.155470 Nov 24 16:19:47.753538 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 632/1241] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:47 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:48.770399 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-62ca6243-31e3-4049-ac13-f2256178e1c6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:48.771094 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-62ca6243-31e3-4049-ac13-f2256178e1c6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:48.777592 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-62ca6243-31e3-4049-ac13-f2256178e1c6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:48.778040 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-62ca6243-31e3-4049-ac13-f2256178e1c6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:48.778855 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-62ca6243-31e3-4049-ac13-f2256178e1c6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:48.779289 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-62ca6243-31e3-4049-ac13-f2256178e1c6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:48.915822 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-62ca6243-31e3-4049-ac13-f2256178e1c6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:48.924225 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-62ca6243-31e3-4049-ac13-f2256178e1c6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1577 microversion: 2.1 time: 0.157857 Nov 24 16:19:48.924954 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 610/1242] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:48 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:49.942117 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5f22f1a5-e091-43eb-9f88-e5074b2149f3 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:49.942712 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5f22f1a5-e091-43eb-9f88-e5074b2149f3 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:49.959367 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f22f1a5-e091-43eb-9f88-e5074b2149f3 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:49.960476 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f22f1a5-e091-43eb-9f88-e5074b2149f3 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:49.961533 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f22f1a5-e091-43eb-9f88-e5074b2149f3 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:49.961975 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5f22f1a5-e091-43eb-9f88-e5074b2149f3 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:50.027732 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-5f22f1a5-e091-43eb-9f88-e5074b2149f3 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:50.035344 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5f22f1a5-e091-43eb-9f88-e5074b2149f3 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 200 len: 1510 microversion: 2.1 time: 0.096946 Nov 24 16:19:50.035916 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 633/1243] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:49 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 1510 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:50.167568 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-a0e57a0e-6359-4d31-be7a-527c33402087 req-a18c224a-26ac-4621-89d1-75b68c674fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2843917b-11a2-42d7-bf56-f60e26980b1f", "name": "network-vif-deleted", "tag": "d9123976-7ebf-4103-a11c-67a75901f6c9"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:19:50.169173 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:19:50.169173 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:19:50.176827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-a0e57a0e-6359-4d31-be7a-527c33402087 req-a18c224a-26ac-4621-89d1-75b68c674fc8 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:50.177305 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-a0e57a0e-6359-4d31-be7a-527c33402087 req-a18c224a-26ac-4621-89d1-75b68c674fc8 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:50.189639 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-a0e57a0e-6359-4d31-be7a-527c33402087 req-a18c224a-26ac-4621-89d1-75b68c674fc8 service nova] Creating event network-vif-deleted:d9123976-7ebf-4103-a11c-67a75901f6c9 for instance 2843917b-11a2-42d7-bf56-f60e26980b1f on hv-cinder-81899 Nov 24 16:19:50.195785 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-a0e57a0e-6359-4d31-be7a-527c33402087 req-a18c224a-26ac-4621-89d1-75b68c674fc8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032084 Nov 24 16:19:50.200335 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 611/1244] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:19:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:19:51.052909 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b524baf0-0537-4ffe-9d17-3882dd22b2a5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:51.053669 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-b524baf0-0537-4ffe-9d17-3882dd22b2a5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:51.060292 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b524baf0-0537-4ffe-9d17-3882dd22b2a5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:51.060743 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b524baf0-0537-4ffe-9d17-3882dd22b2a5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:51.061654 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b524baf0-0537-4ffe-9d17-3882dd22b2a5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:51.062038 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-b524baf0-0537-4ffe-9d17-3882dd22b2a5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:51.076263 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-b524baf0-0537-4ffe-9d17-3882dd22b2a5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] HTTP exception thrown: Instance 2843917b-11a2-42d7-bf56-f60e26980b1f could not be found. Nov 24 16:19:51.076860 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-b524baf0-0537-4ffe-9d17-3882dd22b2a5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Returning 404 to user: Instance 2843917b-11a2-42d7-bf56-f60e26980b1f could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:19:51.077733 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-b524baf0-0537-4ffe-9d17-3882dd22b2a5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 404 len: 111 microversion: 2.1 time: 0.028727 Nov 24 16:19:51.078288 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 634/1245] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:51 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:19:51.173685 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1756958650", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1778100134", "security_groups": [{"name": "tempest-secgroup-smoke-504417305"}], "block_device_mapping_v2": [{"uuid": "85265789-1a65-490a-aafb-4b404cb0bcb2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e94d2a4c-106b-44d2-b8a7-a2440253d60c"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:19:51.288064 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] validate_networks() for [('e94d2a4c-106b-44d2-b8a7-a2440253d60c', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:19:51.714274 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:19:51.714694 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:19:51.715164 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:19:51.715569 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:19:51.715998 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:19:51.724473 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:51.724912 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:51.726080 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:51.726535 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:51.743094 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Getting quotas for project 7ae2d50102bf491986834edf07a6a868. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:19:51.746975 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Getting quotas for user 1181f7a15e6d4732865fe02f985bf189 and project 7ae2d50102bf491986834edf07a6a868. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:19:51.805534 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:19:51.807796 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='85265789-1a65-490a-aafb-4b404cb0bcb2',volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:19:51.930705 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b6d2f375-bbf1-4b03-8a0f-5364312d6334 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.761287 Nov 24 16:19:51.931352 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 612/1246] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:19:51 2021] POST /compute/v2.1/servers => generated 405 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:19:51.941149 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fdca1ba9-eabc-4331-825b-fd6da09e11a2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:51.941758 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fdca1ba9-eabc-4331-825b-fd6da09e11a2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:51.997209 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-fdca1ba9-eabc-4331-825b-fd6da09e11a2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:52.004016 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fdca1ba9-eabc-4331-825b-fd6da09e11a2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1095 microversion: 2.1 time: 0.066599 Nov 24 16:19:52.005275 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 635/1247] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:51 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:53.022859 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f50314fc-b3fe-4f34-8ce1-376a962f0493 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:53.023555 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f50314fc-b3fe-4f34-8ce1-376a962f0493 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:53.031984 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f50314fc-b3fe-4f34-8ce1-376a962f0493 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:53.032517 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f50314fc-b3fe-4f34-8ce1-376a962f0493 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:53.033443 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f50314fc-b3fe-4f34-8ce1-376a962f0493 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:53.033873 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f50314fc-b3fe-4f34-8ce1-376a962f0493 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:53.260746 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f50314fc-b3fe-4f34-8ce1-376a962f0493 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:53.268718 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f50314fc-b3fe-4f34-8ce1-376a962f0493 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1211 microversion: 2.1 time: 0.250164 Nov 24 16:19:53.269388 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 613/1248] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:53 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1211 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:54.188237 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-afeff31c-1e26-45af-9e3b-937cb84ccdab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:19:54.190864 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:19:54.190864 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:19:54.202745 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-afeff31c-1e26-45af-9e3b-937cb84ccdab service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:54.203186 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-afeff31c-1e26-45af-9e3b-937cb84ccdab service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:54.227961 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-afeff31c-1e26-45af-9e3b-937cb84ccdab service nova] Creating event network-changed:f28496a8-b616-467e-a96a-64cd302d5c4e for instance 010bad81-4c64-4106-8ff5-ba171e3352ff on hv-cinder-81899 Nov 24 16:19:54.233461 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-e115d8c9-af83-49ce-9436-d6246372a7f1 req-afeff31c-1e26-45af-9e3b-937cb84ccdab service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050566 Nov 24 16:19:54.234229 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 636/1249] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:19:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:19:54.287168 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1f630bc1-edad-4d7c-aeab-071baa62dad2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:54.287819 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1f630bc1-edad-4d7c-aeab-071baa62dad2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:54.294972 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1f630bc1-edad-4d7c-aeab-071baa62dad2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:54.295437 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1f630bc1-edad-4d7c-aeab-071baa62dad2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:54.296229 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1f630bc1-edad-4d7c-aeab-071baa62dad2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:54.296690 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1f630bc1-edad-4d7c-aeab-071baa62dad2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:54.495068 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1f630bc1-edad-4d7c-aeab-071baa62dad2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:54.502945 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1f630bc1-edad-4d7c-aeab-071baa62dad2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1266 microversion: 2.1 time: 0.220726 Nov 24 16:19:54.503851 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 614/1250] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:54 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:55.521778 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-8069d24d-8ef4-4d2b-8949-81792b43787c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:55.524095 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-8069d24d-8ef4-4d2b-8949-81792b43787c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:55.529407 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8069d24d-8ef4-4d2b-8949-81792b43787c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:55.529860 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8069d24d-8ef4-4d2b-8949-81792b43787c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:55.530660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8069d24d-8ef4-4d2b-8949-81792b43787c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:55.531096 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-8069d24d-8ef4-4d2b-8949-81792b43787c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:55.668456 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-8069d24d-8ef4-4d2b-8949-81792b43787c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:55.675646 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-8069d24d-8ef4-4d2b-8949-81792b43787c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1266 microversion: 2.1 time: 0.158591 Nov 24 16:19:55.676203 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 637/1251] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:55 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:56.692410 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-abe07b68-3cdf-4651-9922-9a950b14d519 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:56.693016 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-abe07b68-3cdf-4651-9922-9a950b14d519 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:56.699581 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-abe07b68-3cdf-4651-9922-9a950b14d519 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:56.700033 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-abe07b68-3cdf-4651-9922-9a950b14d519 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:56.700812 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-abe07b68-3cdf-4651-9922-9a950b14d519 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:56.701287 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-abe07b68-3cdf-4651-9922-9a950b14d519 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:57.086346 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-abe07b68-3cdf-4651-9922-9a950b14d519 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:57.093732 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-abe07b68-3cdf-4651-9922-9a950b14d519 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1266 microversion: 2.1 time: 0.404994 Nov 24 16:19:57.094319 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 615/1252] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:56 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1266 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:58.110557 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-3045b577-7361-4fdd-8437-a3dc79bf964e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:58.111155 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-3045b577-7361-4fdd-8437-a3dc79bf964e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:58.118026 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3045b577-7361-4fdd-8437-a3dc79bf964e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:58.118465 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3045b577-7361-4fdd-8437-a3dc79bf964e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:58.119225 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3045b577-7361-4fdd-8437-a3dc79bf964e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:58.119650 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-3045b577-7361-4fdd-8437-a3dc79bf964e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:58.255818 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-3045b577-7361-4fdd-8437-a3dc79bf964e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:58.263295 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-3045b577-7361-4fdd-8437-a3dc79bf964e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1266 microversion: 2.1 time: 0.156384 Nov 24 16:19:58.263845 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 638/1253] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:58 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:19:59.280393 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b54ba7b9-c5d3-40c5-8199-825c7fcb8423 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:19:59.281001 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b54ba7b9-c5d3-40c5-8199-825c7fcb8423 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:19:59.287284 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b54ba7b9-c5d3-40c5-8199-825c7fcb8423 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:59.288472 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b54ba7b9-c5d3-40c5-8199-825c7fcb8423 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:59.289308 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b54ba7b9-c5d3-40c5-8199-825c7fcb8423 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:19:59.289749 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b54ba7b9-c5d3-40c5-8199-825c7fcb8423 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:19:59.419512 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b54ba7b9-c5d3-40c5-8199-825c7fcb8423 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:19:59.426752 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b54ba7b9-c5d3-40c5-8199-825c7fcb8423 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1266 microversion: 2.1 time: 0.150037 Nov 24 16:19:59.427310 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 616/1254] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:19:59 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:20:00.443824 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-45466edf-44fa-4193-9e4d-486bbbdd9065 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:20:00.444985 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-45466edf-44fa-4193-9e4d-486bbbdd9065 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:20:00.451372 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-45466edf-44fa-4193-9e4d-486bbbdd9065 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:20:00.451820 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-45466edf-44fa-4193-9e4d-486bbbdd9065 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:20:00.452611 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-45466edf-44fa-4193-9e4d-486bbbdd9065 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:20:00.453075 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-45466edf-44fa-4193-9e4d-486bbbdd9065 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:20:00.586132 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-45466edf-44fa-4193-9e4d-486bbbdd9065 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:20:00.593353 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-45466edf-44fa-4193-9e4d-486bbbdd9065 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1266 microversion: 2.1 time: 0.153246 Nov 24 16:20:00.593923 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 639/1255] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:20:00 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:20:01.610649 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fa1a20c6-394f-4e40-8f91-1b46fd849a80 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:20:01.611262 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fa1a20c6-394f-4e40-8f91-1b46fd849a80 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:20:01.618255 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa1a20c6-394f-4e40-8f91-1b46fd849a80 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:20:01.618709 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa1a20c6-394f-4e40-8f91-1b46fd849a80 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:20:01.619495 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa1a20c6-394f-4e40-8f91-1b46fd849a80 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:20:01.619937 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fa1a20c6-394f-4e40-8f91-1b46fd849a80 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:20:01.751650 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fa1a20c6-394f-4e40-8f91-1b46fd849a80 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:20:01.760280 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fa1a20c6-394f-4e40-8f91-1b46fd849a80 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1266 microversion: 2.1 time: 0.153636 Nov 24 16:20:01.760846 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 617/1256] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:20:01 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:20:02.777790 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-dddd3d22-242f-4d4e-8f86-35ebcd2f204e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:20:02.778427 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-dddd3d22-242f-4d4e-8f86-35ebcd2f204e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:20:02.784746 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dddd3d22-242f-4d4e-8f86-35ebcd2f204e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:20:02.785228 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dddd3d22-242f-4d4e-8f86-35ebcd2f204e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:20:02.786007 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dddd3d22-242f-4d4e-8f86-35ebcd2f204e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:20:02.786446 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-dddd3d22-242f-4d4e-8f86-35ebcd2f204e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:20:02.917530 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-dddd3d22-242f-4d4e-8f86-35ebcd2f204e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:20:02.924898 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-dddd3d22-242f-4d4e-8f86-35ebcd2f204e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1266 microversion: 2.1 time: 0.150916 Nov 24 16:20:02.925505 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 640/1257] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:20:02 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:20:03.459101 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-146bccbd-cb92-4c2d-adcb-61e9e602557a req-4ecf56d1-1328-481b-8c5b-5046a3eb3546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "name": "network-vif-plugged", "status": "completed", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:20:03.461699 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:20:03.461699 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:20:03.470346 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-146bccbd-cb92-4c2d-adcb-61e9e602557a req-4ecf56d1-1328-481b-8c5b-5046a3eb3546 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:20:03.470789 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-146bccbd-cb92-4c2d-adcb-61e9e602557a req-4ecf56d1-1328-481b-8c5b-5046a3eb3546 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:20:03.493643 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-146bccbd-cb92-4c2d-adcb-61e9e602557a req-4ecf56d1-1328-481b-8c5b-5046a3eb3546 service nova] Creating event network-vif-plugged:f28496a8-b616-467e-a96a-64cd302d5c4e for instance 010bad81-4c64-4106-8ff5-ba171e3352ff on hv-cinder-81899 Nov 24 16:20:03.500449 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-146bccbd-cb92-4c2d-adcb-61e9e602557a req-4ecf56d1-1328-481b-8c5b-5046a3eb3546 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044948 Nov 24 16:20:03.501073 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 618/1258] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:20:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:20:03.941260 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-1c2e78d0-793d-4bfb-a656-ed4ca5bb7750 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:20:03.941875 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-1c2e78d0-793d-4bfb-a656-ed4ca5bb7750 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:20:03.949367 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1c2e78d0-793d-4bfb-a656-ed4ca5bb7750 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:20:03.949820 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1c2e78d0-793d-4bfb-a656-ed4ca5bb7750 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:20:03.950617 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1c2e78d0-793d-4bfb-a656-ed4ca5bb7750 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:20:03.951096 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-1c2e78d0-793d-4bfb-a656-ed4ca5bb7750 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:20:04.087607 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-1c2e78d0-793d-4bfb-a656-ed4ca5bb7750 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:20:04.094953 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-1c2e78d0-793d-4bfb-a656-ed4ca5bb7750 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1266 microversion: 2.1 time: 0.157489 Nov 24 16:20:04.095525 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 641/1259] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:20:03 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:20:05.112514 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d9c1ad58-d68b-4b0b-92b0-a99b17bc01a9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:20:05.113241 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d9c1ad58-d68b-4b0b-92b0-a99b17bc01a9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:20:05.121984 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d9c1ad58-d68b-4b0b-92b0-a99b17bc01a9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:20:05.122561 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d9c1ad58-d68b-4b0b-92b0-a99b17bc01a9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:20:05.124282 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d9c1ad58-d68b-4b0b-92b0-a99b17bc01a9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:20:05.125329 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d9c1ad58-d68b-4b0b-92b0-a99b17bc01a9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:20:05.262884 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d9c1ad58-d68b-4b0b-92b0-a99b17bc01a9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:20:05.270401 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d9c1ad58-d68b-4b0b-92b0-a99b17bc01a9 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1454 microversion: 2.1 time: 0.161973 Nov 24 16:20:05.270968 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 619/1260] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:20:05 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:20:05.290158 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-fefae74d-8c33-48ae-8bb2-381d4603d8a2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:20:05.290887 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-fefae74d-8c33-48ae-8bb2-381d4603d8a2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:20:05.298253 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fefae74d-8c33-48ae-8bb2-381d4603d8a2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:20:05.298770 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fefae74d-8c33-48ae-8bb2-381d4603d8a2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:20:05.299618 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fefae74d-8c33-48ae-8bb2-381d4603d8a2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:20:05.300135 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-fefae74d-8c33-48ae-8bb2-381d4603d8a2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:20:05.432151 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-fefae74d-8c33-48ae-8bb2-381d4603d8a2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:20:05.440526 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-fefae74d-8c33-48ae-8bb2-381d4603d8a2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1454 microversion: 2.1 time: 0.157732 Nov 24 16:20:05.441102 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 642/1261] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:20:05 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:20:07.407297 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-92f84eca-79dd-4d92-adb3-37427bcb038e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:20:07.409042 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:20:07.409042 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:20:07.417000 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-92f84eca-79dd-4d92-adb3-37427bcb038e service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:20:07.417669 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-92f84eca-79dd-4d92-adb3-37427bcb038e service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:20:07.428829 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-92f84eca-79dd-4d92-adb3-37427bcb038e service nova] Creating event network-changed:f28496a8-b616-467e-a96a-64cd302d5c4e for instance 010bad81-4c64-4106-8ff5-ba171e3352ff on hv-cinder-81899 Nov 24 16:20:07.434113 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-ae695356-95fa-4cbe-a460-f0c32d76770b req-92f84eca-79dd-4d92-adb3-37427bcb038e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117834 Nov 24 16:20:07.435003 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 620/1262] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:20:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:20:15.730019 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:20:15.730624 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: Wed Nov 24 16:20:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:21:36.737482 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:21:36.738217 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: Wed Nov 24 16:21:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:21:48.861736 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2b8332e9-05df-4024-8817-3afe58683760 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:21:48.862344 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2b8332e9-05df-4024-8817-3afe58683760 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:21:48.868396 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2b8332e9-05df-4024-8817-3afe58683760 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:48.868842 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2b8332e9-05df-4024-8817-3afe58683760 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:48.869649 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2b8332e9-05df-4024-8817-3afe58683760 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:48.870074 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2b8332e9-05df-4024-8817-3afe58683760 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:48.893335 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.objects.instance [None req-2b8332e9-05df-4024-8817-3afe58683760 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lazy-loading 'flavor' on Instance uuid 47ed20e5-f963-4489-aa73-4d9e4306db2b {{(pid=116303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:21:48.966935 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2b8332e9-05df-4024-8817-3afe58683760 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "POST /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b/action" status: 202 len: 0 microversion: 2.1 time: 0.109764 Nov 24 16:21:48.967534 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 643/1263] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:21:48 2021] POST /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:21:48.973957 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a467d258-cdcf-40cd-9f48-9a166b4ced98] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 24 16:21:48.977861 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d68337b5-c2fa-40c2-bc24-06be31a1ef76 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:21:48.978546 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d68337b5-c2fa-40c2-bc24-06be31a1ef76 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:21:48.984711 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d68337b5-c2fa-40c2-bc24-06be31a1ef76 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:48.985200 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d68337b5-c2fa-40c2-bc24-06be31a1ef76 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:48.985984 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d68337b5-c2fa-40c2-bc24-06be31a1ef76 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:48.986418 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d68337b5-c2fa-40c2-bc24-06be31a1ef76 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:49.180059 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d68337b5-c2fa-40c2-bc24-06be31a1ef76 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:21:49.187609 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d68337b5-c2fa-40c2-bc24-06be31a1ef76 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1569 microversion: 2.1 time: 0.215482 Nov 24 16:21:49.188169 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 621/1264] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:21:48 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:21:50.206087 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-118c11ac-e71e-4922-9b64-0ac6d23d132a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:21:50.206773 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-118c11ac-e71e-4922-9b64-0ac6d23d132a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:21:50.214484 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-118c11ac-e71e-4922-9b64-0ac6d23d132a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:50.214925 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-118c11ac-e71e-4922-9b64-0ac6d23d132a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:50.215700 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-118c11ac-e71e-4922-9b64-0ac6d23d132a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:50.216126 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-118c11ac-e71e-4922-9b64-0ac6d23d132a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:50.405990 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-118c11ac-e71e-4922-9b64-0ac6d23d132a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:21:50.414150 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-118c11ac-e71e-4922-9b64-0ac6d23d132a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1569 microversion: 2.1 time: 0.212110 Nov 24 16:21:50.414714 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 644/1265] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:21:50 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:21:51.432597 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6ff42e87-eee4-4315-90ad-ba63b5e97461 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:21:51.433221 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6ff42e87-eee4-4315-90ad-ba63b5e97461 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:21:51.450257 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6ff42e87-eee4-4315-90ad-ba63b5e97461 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:51.450709 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6ff42e87-eee4-4315-90ad-ba63b5e97461 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:51.451505 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6ff42e87-eee4-4315-90ad-ba63b5e97461 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:51.451944 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6ff42e87-eee4-4315-90ad-ba63b5e97461 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:51.468880 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] [a467d258-cdcf-40cd-9f48-9a166b4ced98] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 60978. Nov 24 16:21:51.601642 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6ff42e87-eee4-4315-90ad-ba63b5e97461 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:21:51.609224 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6ff42e87-eee4-4315-90ad-ba63b5e97461 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1569 microversion: 2.1 time: 0.180301 Nov 24 16:21:51.609799 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 622/1266] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:21:51 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:21:52.626471 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5a150a36-705f-4e57-b2a4-276fa1987345 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:21:52.627081 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5a150a36-705f-4e57-b2a4-276fa1987345 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:21:52.634207 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5a150a36-705f-4e57-b2a4-276fa1987345 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:52.634655 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5a150a36-705f-4e57-b2a4-276fa1987345 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:52.635593 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5a150a36-705f-4e57-b2a4-276fa1987345 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:52.636028 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5a150a36-705f-4e57-b2a4-276fa1987345 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:52.776505 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-5a150a36-705f-4e57-b2a4-276fa1987345 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:21:52.784311 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5a150a36-705f-4e57-b2a4-276fa1987345 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1569 microversion: 2.1 time: 0.161896 Nov 24 16:21:52.784874 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 645/1267] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:21:52 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:21:53.801665 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8c55621c-8097-4073-9791-db4ae2a39e1a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:21:53.802246 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8c55621c-8097-4073-9791-db4ae2a39e1a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:21:53.808579 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c55621c-8097-4073-9791-db4ae2a39e1a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:53.809093 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c55621c-8097-4073-9791-db4ae2a39e1a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:53.809954 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c55621c-8097-4073-9791-db4ae2a39e1a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:53.810528 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c55621c-8097-4073-9791-db4ae2a39e1a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:53.953980 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-8c55621c-8097-4073-9791-db4ae2a39e1a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:21:53.963615 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8c55621c-8097-4073-9791-db4ae2a39e1a tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1569 microversion: 2.1 time: 0.165097 Nov 24 16:21:53.963615 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 623/1268] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:21:53 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:21:54.980005 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-75929f6d-2917-447f-88c7-15560e84764c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:21:54.980619 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-75929f6d-2917-447f-88c7-15560e84764c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:21:54.986920 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-75929f6d-2917-447f-88c7-15560e84764c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:54.987371 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-75929f6d-2917-447f-88c7-15560e84764c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:54.988153 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-75929f6d-2917-447f-88c7-15560e84764c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:54.988647 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-75929f6d-2917-447f-88c7-15560e84764c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:55.122195 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-75929f6d-2917-447f-88c7-15560e84764c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:21:55.130966 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-75929f6d-2917-447f-88c7-15560e84764c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1569 microversion: 2.1 time: 0.154670 Nov 24 16:21:55.131538 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 646/1269] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:21:54 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:21:56.147296 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b2ec3e06-6d9c-4954-8934-911d6cf12daf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:21:56.148009 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b2ec3e06-6d9c-4954-8934-911d6cf12daf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:21:56.154260 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b2ec3e06-6d9c-4954-8934-911d6cf12daf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:56.154715 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b2ec3e06-6d9c-4954-8934-911d6cf12daf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:56.155499 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b2ec3e06-6d9c-4954-8934-911d6cf12daf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:56.155941 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b2ec3e06-6d9c-4954-8934-911d6cf12daf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:56.293480 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b2ec3e06-6d9c-4954-8934-911d6cf12daf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:21:56.300801 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b2ec3e06-6d9c-4954-8934-911d6cf12daf tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1569 microversion: 2.1 time: 0.157482 Nov 24 16:21:56.301987 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 624/1270] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:21:56 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:21:57.318866 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-88f4b2ee-8001-4137-a500-89bb45ebaaab tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:21:57.319410 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-88f4b2ee-8001-4137-a500-89bb45ebaaab tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:21:57.325765 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88f4b2ee-8001-4137-a500-89bb45ebaaab tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:57.326220 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88f4b2ee-8001-4137-a500-89bb45ebaaab tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:57.326998 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88f4b2ee-8001-4137-a500-89bb45ebaaab tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:57.327435 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-88f4b2ee-8001-4137-a500-89bb45ebaaab tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:57.471542 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-88f4b2ee-8001-4137-a500-89bb45ebaaab tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:21:57.480790 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-88f4b2ee-8001-4137-a500-89bb45ebaaab tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1569 microversion: 2.1 time: 0.165983 Nov 24 16:21:57.481391 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 647/1271] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:21:57 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:21:58.497703 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c96ac158-c96c-419a-8576-6ae718ff37b2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:21:58.498260 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c96ac158-c96c-419a-8576-6ae718ff37b2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:21:58.505383 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c96ac158-c96c-419a-8576-6ae718ff37b2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:58.505832 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c96ac158-c96c-419a-8576-6ae718ff37b2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:58.506618 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c96ac158-c96c-419a-8576-6ae718ff37b2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:58.507057 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c96ac158-c96c-419a-8576-6ae718ff37b2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:58.645651 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c96ac158-c96c-419a-8576-6ae718ff37b2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:21:58.653231 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c96ac158-c96c-419a-8576-6ae718ff37b2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1569 microversion: 2.1 time: 0.159578 Nov 24 16:21:58.653798 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 625/1272] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:21:58 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:21:59.525847 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:21:59.526536 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: Wed Nov 24 16:21:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:21:59.669871 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d50412ad-2fee-40c2-b914-11e2632c5559 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:21:59.670908 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d50412ad-2fee-40c2-b914-11e2632c5559 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:21:59.677384 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d50412ad-2fee-40c2-b914-11e2632c5559 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:59.677833 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d50412ad-2fee-40c2-b914-11e2632c5559 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:59.678704 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d50412ad-2fee-40c2-b914-11e2632c5559 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:21:59.679138 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d50412ad-2fee-40c2-b914-11e2632c5559 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:21:59.812317 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d50412ad-2fee-40c2-b914-11e2632c5559 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:21:59.820243 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d50412ad-2fee-40c2-b914-11e2632c5559 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1569 microversion: 2.1 time: 0.154091 Nov 24 16:21:59.820815 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 648/1273] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:21:59 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:00.375006 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:22:00.375491 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: Wed Nov 24 16:22:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:22:00.837330 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-b208814d-2018-48c5-bbeb-c87415333efc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:00.838030 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-b208814d-2018-48c5-bbeb-c87415333efc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:00.844324 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b208814d-2018-48c5-bbeb-c87415333efc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:00.844773 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b208814d-2018-48c5-bbeb-c87415333efc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:00.845583 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b208814d-2018-48c5-bbeb-c87415333efc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:00.846014 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-b208814d-2018-48c5-bbeb-c87415333efc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:00.980558 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-b208814d-2018-48c5-bbeb-c87415333efc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:00.987872 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-b208814d-2018-48c5-bbeb-c87415333efc tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1569 microversion: 2.1 time: 0.154265 Nov 24 16:22:00.989152 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 626/1274] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:00 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:02.007311 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-72f0e5c0-c250-41dd-8c37-752dba20aef6 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:02.007947 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-72f0e5c0-c250-41dd-8c37-752dba20aef6 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:02.014262 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-72f0e5c0-c250-41dd-8c37-752dba20aef6 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:02.014708 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-72f0e5c0-c250-41dd-8c37-752dba20aef6 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:02.015494 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-72f0e5c0-c250-41dd-8c37-752dba20aef6 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:02.015929 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-72f0e5c0-c250-41dd-8c37-752dba20aef6 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:02.151623 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-72f0e5c0-c250-41dd-8c37-752dba20aef6 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:02.159077 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-72f0e5c0-c250-41dd-8c37-752dba20aef6 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1510 microversion: 2.1 time: 0.156547 Nov 24 16:22:02.159639 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 649/1275] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:02 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:02.176431 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:22:02.177101 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:02.183585 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:02.184037 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:02.184831 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:02.185299 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:02.261218 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-8c98af57-74ca-4cf9-b5aa-182c2ec3419b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "POST /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b/action" status: 202 len: 0 microversion: 2.1 time: 0.088871 Nov 24 16:22:02.261711 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 627/1276] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Nov 24 16:22:02 2021] POST /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:22:02.269632 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-35b8d19d-49ec-45b7-9ca4-b5e35196a6e8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:02.270395 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-35b8d19d-49ec-45b7-9ca4-b5e35196a6e8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:02.276785 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-35b8d19d-49ec-45b7-9ca4-b5e35196a6e8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:02.277274 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-35b8d19d-49ec-45b7-9ca4-b5e35196a6e8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:02.278100 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-35b8d19d-49ec-45b7-9ca4-b5e35196a6e8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:02.278715 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-35b8d19d-49ec-45b7-9ca4-b5e35196a6e8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:02.468043 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-35b8d19d-49ec-45b7-9ca4-b5e35196a6e8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:02.477050 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-35b8d19d-49ec-45b7-9ca4-b5e35196a6e8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1518 microversion: 2.1 time: 0.210907 Nov 24 16:22:02.477774 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 650/1277] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:02 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1518 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:03.494972 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ef893ad4-72ca-4965-836b-1c26c1095a78 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:03.495530 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ef893ad4-72ca-4965-836b-1c26c1095a78 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:03.501918 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef893ad4-72ca-4965-836b-1c26c1095a78 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:03.502366 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef893ad4-72ca-4965-836b-1c26c1095a78 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:03.503155 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef893ad4-72ca-4965-836b-1c26c1095a78 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:03.503626 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ef893ad4-72ca-4965-836b-1c26c1095a78 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:03.648233 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ef893ad4-72ca-4965-836b-1c26c1095a78 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:03.656023 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ef893ad4-72ca-4965-836b-1c26c1095a78 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1518 microversion: 2.1 time: 0.165267 Nov 24 16:22:03.656600 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 628/1278] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:03 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:04.673167 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-35824e97-1f7a-497f-8a3a-bb7a7dda7a3b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:04.673781 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-35824e97-1f7a-497f-8a3a-bb7a7dda7a3b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:04.680188 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-35824e97-1f7a-497f-8a3a-bb7a7dda7a3b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:04.680637 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-35824e97-1f7a-497f-8a3a-bb7a7dda7a3b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:04.681467 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-35824e97-1f7a-497f-8a3a-bb7a7dda7a3b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:04.681904 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-35824e97-1f7a-497f-8a3a-bb7a7dda7a3b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:04.825057 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-35824e97-1f7a-497f-8a3a-bb7a7dda7a3b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:04.835233 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-35824e97-1f7a-497f-8a3a-bb7a7dda7a3b tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1518 microversion: 2.1 time: 0.165746 Nov 24 16:22:04.836059 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 651/1279] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:04 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:05.853051 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-148120c2-563c-4472-99eb-039323552ee8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:05.853664 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-148120c2-563c-4472-99eb-039323552ee8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:05.861067 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-148120c2-563c-4472-99eb-039323552ee8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:05.861067 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-148120c2-563c-4472-99eb-039323552ee8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:05.861349 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-148120c2-563c-4472-99eb-039323552ee8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:05.861780 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-148120c2-563c-4472-99eb-039323552ee8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:05.973316 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-50b593d5-05c7-4245-96dc-d568fc0d5ed1 req-4f21874a-af92-4f1d-bb19-f205eca0c00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "name": "network-vif-unplugged", "status": "completed", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:22:05.975739 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:22:05.975739 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:22:05.983605 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-50b593d5-05c7-4245-96dc-d568fc0d5ed1 req-4f21874a-af92-4f1d-bb19-f205eca0c00e service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:05.984045 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-50b593d5-05c7-4245-96dc-d568fc0d5ed1 req-4f21874a-af92-4f1d-bb19-f205eca0c00e service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:05.996583 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-50b593d5-05c7-4245-96dc-d568fc0d5ed1 req-4f21874a-af92-4f1d-bb19-f205eca0c00e service nova] Creating event network-vif-unplugged:3762c609-4d3f-4e0f-a146-c0077e3c9f5c for instance 47ed20e5-f963-4489-aa73-4d9e4306db2b on hv-cinder-81899 Nov 24 16:22:06.002657 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-50b593d5-05c7-4245-96dc-d568fc0d5ed1 req-4f21874a-af92-4f1d-bb19-f205eca0c00e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033546 Nov 24 16:22:06.003427 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 652/1280] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:22:05 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:22:06.092855 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-148120c2-563c-4472-99eb-039323552ee8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:06.101330 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-148120c2-563c-4472-99eb-039323552ee8 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1576 microversion: 2.1 time: 0.252032 Nov 24 16:22:06.101851 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 629/1281] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:05 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:07.119842 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ee356c07-8704-4801-b49d-df6922b7fcad tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:07.120561 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ee356c07-8704-4801-b49d-df6922b7fcad tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:07.126960 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ee356c07-8704-4801-b49d-df6922b7fcad tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:07.127398 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ee356c07-8704-4801-b49d-df6922b7fcad tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:07.128163 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ee356c07-8704-4801-b49d-df6922b7fcad tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:07.128591 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ee356c07-8704-4801-b49d-df6922b7fcad tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:07.265820 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-ee356c07-8704-4801-b49d-df6922b7fcad tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:07.273747 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ee356c07-8704-4801-b49d-df6922b7fcad tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1576 microversion: 2.1 time: 0.158358 Nov 24 16:22:07.274313 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 653/1282] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:07 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:22:08.291543 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-fae9900b-2182-4000-b13b-8e13b6567e72 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:08.292178 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-fae9900b-2182-4000-b13b-8e13b6567e72 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:08.298457 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fae9900b-2182-4000-b13b-8e13b6567e72 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:08.298905 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fae9900b-2182-4000-b13b-8e13b6567e72 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:08.299688 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fae9900b-2182-4000-b13b-8e13b6567e72 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:08.300124 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-fae9900b-2182-4000-b13b-8e13b6567e72 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:08.436784 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-fae9900b-2182-4000-b13b-8e13b6567e72 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:08.444712 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-fae9900b-2182-4000-b13b-8e13b6567e72 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1576 microversion: 2.1 time: 0.156916 Nov 24 16:22:08.445310 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 630/1283] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:08 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:09.462468 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-afb3a17d-3708-459c-9026-1bff6c276441 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:09.463021 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-afb3a17d-3708-459c-9026-1bff6c276441 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:09.469360 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-afb3a17d-3708-459c-9026-1bff6c276441 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:09.469810 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-afb3a17d-3708-459c-9026-1bff6c276441 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:09.470591 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-afb3a17d-3708-459c-9026-1bff6c276441 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:09.471031 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-afb3a17d-3708-459c-9026-1bff6c276441 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:09.607535 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-afb3a17d-3708-459c-9026-1bff6c276441 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:09.616801 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-afb3a17d-3708-459c-9026-1bff6c276441 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1576 microversion: 2.1 time: 0.157963 Nov 24 16:22:09.617769 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 654/1284] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:09 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:10.635306 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-c54766a0-23c6-42ce-9744-4533bee21b2c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:10.635877 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-c54766a0-23c6-42ce-9744-4533bee21b2c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:10.642150 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c54766a0-23c6-42ce-9744-4533bee21b2c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:10.642604 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c54766a0-23c6-42ce-9744-4533bee21b2c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:10.643431 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c54766a0-23c6-42ce-9744-4533bee21b2c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:10.643866 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-c54766a0-23c6-42ce-9744-4533bee21b2c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:10.775257 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-c54766a0-23c6-42ce-9744-4533bee21b2c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:10.782702 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-c54766a0-23c6-42ce-9744-4533bee21b2c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1576 microversion: 2.1 time: 0.151232 Nov 24 16:22:10.783252 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 631/1285] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:10 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:11.800130 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-2684f06b-46fc-442b-ab88-019cea74ab3c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:11.801283 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-2684f06b-46fc-442b-ab88-019cea74ab3c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:11.807571 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2684f06b-46fc-442b-ab88-019cea74ab3c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:11.808019 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2684f06b-46fc-442b-ab88-019cea74ab3c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:11.808799 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2684f06b-46fc-442b-ab88-019cea74ab3c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:11.809261 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-2684f06b-46fc-442b-ab88-019cea74ab3c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:11.954628 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-2684f06b-46fc-442b-ab88-019cea74ab3c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:11.962397 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-2684f06b-46fc-442b-ab88-019cea74ab3c tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1576 microversion: 2.1 time: 0.166190 Nov 24 16:22:11.962965 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 655/1286] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:11 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:12.979269 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-02064de4-6822-4a09-866b-cef0e8ab6f73 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:12.979881 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-02064de4-6822-4a09-866b-cef0e8ab6f73 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:12.986321 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-02064de4-6822-4a09-866b-cef0e8ab6f73 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:12.986794 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-02064de4-6822-4a09-866b-cef0e8ab6f73 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:12.987565 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-02064de4-6822-4a09-866b-cef0e8ab6f73 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:12.988266 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-02064de4-6822-4a09-866b-cef0e8ab6f73 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:13.122832 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-02064de4-6822-4a09-866b-cef0e8ab6f73 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:13.131225 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-02064de4-6822-4a09-866b-cef0e8ab6f73 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1576 microversion: 2.1 time: 0.155518 Nov 24 16:22:13.131888 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 632/1287] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:12 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:14.148071 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4b541ac2-161f-4805-8594-7b0853e9fb4f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:14.148683 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4b541ac2-161f-4805-8594-7b0853e9fb4f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:14.154724 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4b541ac2-161f-4805-8594-7b0853e9fb4f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:14.155176 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4b541ac2-161f-4805-8594-7b0853e9fb4f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:14.155952 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4b541ac2-161f-4805-8594-7b0853e9fb4f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:14.156386 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4b541ac2-161f-4805-8594-7b0853e9fb4f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:14.290163 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4b541ac2-161f-4805-8594-7b0853e9fb4f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:14.297845 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4b541ac2-161f-4805-8594-7b0853e9fb4f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1576 microversion: 2.1 time: 0.153559 Nov 24 16:22:14.298419 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 656/1288] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:14 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:15.315695 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5f48c3b5-ce3b-4097-bda7-99ba8a105695 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:15.316338 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5f48c3b5-ce3b-4097-bda7-99ba8a105695 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:15.323712 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5f48c3b5-ce3b-4097-bda7-99ba8a105695 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:15.324171 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5f48c3b5-ce3b-4097-bda7-99ba8a105695 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:15.325508 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5f48c3b5-ce3b-4097-bda7-99ba8a105695 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:15.326343 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5f48c3b5-ce3b-4097-bda7-99ba8a105695 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:15.465647 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5f48c3b5-ce3b-4097-bda7-99ba8a105695 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:15.472908 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5f48c3b5-ce3b-4097-bda7-99ba8a105695 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1576 microversion: 2.1 time: 0.161057 Nov 24 16:22:15.473519 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 633/1289] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:15 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:16.490462 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-94f79f5d-de3a-48b5-82c7-3f7c052e6edd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:16.490997 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-94f79f5d-de3a-48b5-82c7-3f7c052e6edd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:16.497230 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-94f79f5d-de3a-48b5-82c7-3f7c052e6edd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:16.497681 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-94f79f5d-de3a-48b5-82c7-3f7c052e6edd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:16.498460 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-94f79f5d-de3a-48b5-82c7-3f7c052e6edd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:16.498887 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-94f79f5d-de3a-48b5-82c7-3f7c052e6edd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:16.647595 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-94f79f5d-de3a-48b5-82c7-3f7c052e6edd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:16.656341 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-94f79f5d-de3a-48b5-82c7-3f7c052e6edd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1576 microversion: 2.1 time: 0.169948 Nov 24 16:22:16.656962 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 657/1290] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:16 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:17.673605 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-644ddab5-550b-4478-b26e-0e5cf04d98f2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:17.674229 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-644ddab5-550b-4478-b26e-0e5cf04d98f2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:17.681128 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-644ddab5-550b-4478-b26e-0e5cf04d98f2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:17.681592 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-644ddab5-550b-4478-b26e-0e5cf04d98f2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:17.682379 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-644ddab5-550b-4478-b26e-0e5cf04d98f2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:17.682822 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-644ddab5-550b-4478-b26e-0e5cf04d98f2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:17.820080 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-644ddab5-550b-4478-b26e-0e5cf04d98f2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:17.827418 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-644ddab5-550b-4478-b26e-0e5cf04d98f2 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1563 microversion: 2.1 time: 0.157572 Nov 24 16:22:17.827979 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 634/1291] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:17 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:20.065905 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-e35f227e-b03c-400e-a4f3-1f816b1aa9ce req-ecd167e8-dbc2-4611-9d22-253355f265ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "name": "network-vif-plugged", "status": "completed", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:22:20.067518 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:22:20.067518 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:22:20.075084 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-e35f227e-b03c-400e-a4f3-1f816b1aa9ce req-ecd167e8-dbc2-4611-9d22-253355f265ab service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:20.075559 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-e35f227e-b03c-400e-a4f3-1f816b1aa9ce req-ecd167e8-dbc2-4611-9d22-253355f265ab service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:20.087246 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-e35f227e-b03c-400e-a4f3-1f816b1aa9ce req-ecd167e8-dbc2-4611-9d22-253355f265ab service nova] Creating event network-vif-plugged:3762c609-4d3f-4e0f-a146-c0077e3c9f5c for instance 47ed20e5-f963-4489-aa73-4d9e4306db2b on hv-cinder-81899 Nov 24 16:22:20.092587 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-e35f227e-b03c-400e-a4f3-1f816b1aa9ce req-ecd167e8-dbc2-4611-9d22-253355f265ab service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030336 Nov 24 16:22:20.093584 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 658/1292] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:22:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:22:20.710592 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2110182330", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1778100134", "security_groups": [{"name": "tempest-secgroup-smoke-504417305"}], "block_device_mapping_v2": [{"uuid": "9ddc916b-ddc4-44e0-b2f2-9a55915a6e0e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e94d2a4c-106b-44d2-b8a7-a2440253d60c"}]}} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:22:20.819845 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.network.neutron [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] validate_networks() for [('e94d2a4c-106b-44d2-b8a7-a2440253d60c', None, None, None, None, None)] {{(pid=116304) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 16:22:21.196218 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Flavor limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 16:22:21.196642 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Image limits 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 16:22:21.197141 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Flavor pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 16:22:21.197572 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Image pref 0:0:0 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 16:22:21.197983 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.virt.hardware [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 16:22:21.206699 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:21.207143 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:21.208640 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:21.209104 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:21.225532 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Getting quotas for project 7ae2d50102bf491986834edf07a6a868. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 16:22:21.229534 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.quota [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Getting quotas for user 1181f7a15e6d4732865fe02f985bf189 and project 7ae2d50102bf491986834edf07a6a868. Resources: {'cores', 'ram', 'instances'} {{(pid=116304) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 16:22:21.285977 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Going to run 1 instances... {{(pid=116304) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 16:22:21.288664 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ddc916b-ddc4-44e0-b2f2-9a55915a6e0e',volume_size=None,volume_type=None)] {{(pid=116304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 16:22:21.410479 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5a31cb58-ac1b-4bee-b18e-beefa98371a8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.704450 Nov 24 16:22:21.411333 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 635/1293] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Nov 24 16:22:20 2021] POST /compute/v2.1/servers => generated 405 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 16:22:21.422191 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4267ccc5-35fc-42da-a17d-6b8872a7ffb5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:21.422891 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4267ccc5-35fc-42da-a17d-6b8872a7ffb5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:21.476853 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4267ccc5-35fc-42da-a17d-6b8872a7ffb5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:21.483577 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4267ccc5-35fc-42da-a17d-6b8872a7ffb5 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1095 microversion: 2.1 time: 0.065666 Nov 24 16:22:21.483992 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 659/1294] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:21 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:22.502395 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-6fc5360a-87a1-4eaa-8035-d0bafd8aead8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:22.503076 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-6fc5360a-87a1-4eaa-8035-d0bafd8aead8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:22.508961 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6fc5360a-87a1-4eaa-8035-d0bafd8aead8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:22.509433 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6fc5360a-87a1-4eaa-8035-d0bafd8aead8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:22.510219 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6fc5360a-87a1-4eaa-8035-d0bafd8aead8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:22.510647 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-6fc5360a-87a1-4eaa-8035-d0bafd8aead8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:22.581692 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-6fc5360a-87a1-4eaa-8035-d0bafd8aead8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:22.589987 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-6fc5360a-87a1-4eaa-8035-d0bafd8aead8 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1211 microversion: 2.1 time: 0.092644 Nov 24 16:22:22.590565 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 636/1295] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:22 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:23.607746 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-275d93fc-a28b-4742-b2c4-16472a54fa19 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:23.608342 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-275d93fc-a28b-4742-b2c4-16472a54fa19 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:23.616980 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-275d93fc-a28b-4742-b2c4-16472a54fa19 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:23.617454 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-275d93fc-a28b-4742-b2c4-16472a54fa19 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:23.618251 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-275d93fc-a28b-4742-b2c4-16472a54fa19 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:23.618697 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-275d93fc-a28b-4742-b2c4-16472a54fa19 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:23.772948 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-275d93fc-a28b-4742-b2c4-16472a54fa19 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:23.780887 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-275d93fc-a28b-4742-b2c4-16472a54fa19 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1266 microversion: 2.1 time: 0.176841 Nov 24 16:22:23.781891 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 660/1296] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:23 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:24.002752 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-32ce8b61-94f7-40af-a30a-3697c2dfa3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:22:24.004359 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:22:24.004359 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:22:24.011543 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-32ce8b61-94f7-40af-a30a-3697c2dfa3b1 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:24.011986 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-32ce8b61-94f7-40af-a30a-3697c2dfa3b1 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:24.023303 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-32ce8b61-94f7-40af-a30a-3697c2dfa3b1 service nova] Creating event network-changed:5fb88ff0-bd58-4f17-b36d-7ceece933b04 for instance e5d37abd-923b-419b-805e-303baf82ea67 on hv-cinder-81899 Nov 24 16:22:24.027118 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: ERROR oslo.messaging._drivers.impl_rabbit [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-32ce8b61-94f7-40af-a30a-3697c2dfa3b1 service nova] [8dec0869-a07f-4077-8eb1-23ff7c233560] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 24 16:22:24.798711 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0f46d065-8d93-4d97-9ea3-d13f90a81a57 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:24.799335 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0f46d065-8d93-4d97-9ea3-d13f90a81a57 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:24.806036 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0f46d065-8d93-4d97-9ea3-d13f90a81a57 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:24.806514 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0f46d065-8d93-4d97-9ea3-d13f90a81a57 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:24.807294 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0f46d065-8d93-4d97-9ea3-d13f90a81a57 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:24.807724 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0f46d065-8d93-4d97-9ea3-d13f90a81a57 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:24.943179 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-0f46d065-8d93-4d97-9ea3-d13f90a81a57 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:24.950404 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0f46d065-8d93-4d97-9ea3-d13f90a81a57 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1266 microversion: 2.1 time: 0.155436 Nov 24 16:22:24.950973 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 661/1297] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:24 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 16:22:25.043788 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-32ce8b61-94f7-40af-a30a-3697c2dfa3b1 service nova] [8dec0869-a07f-4077-8eb1-23ff7c233560] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 32898. Nov 24 16:22:25.047308 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-69844ce1-dcaf-49ae-8343-8896b15b849e req-32ce8b61-94f7-40af-a30a-3697c2dfa3b1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.122238 Nov 24 16:22:25.047983 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 637/1298] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:22:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:22:25.967547 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-6d90eca6-b829-420a-8f3d-ed1eabacd2ed tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:25.968163 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-6d90eca6-b829-420a-8f3d-ed1eabacd2ed tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:25.975123 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6d90eca6-b829-420a-8f3d-ed1eabacd2ed tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:25.975563 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6d90eca6-b829-420a-8f3d-ed1eabacd2ed tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:25.976332 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6d90eca6-b829-420a-8f3d-ed1eabacd2ed tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:25.976761 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-6d90eca6-b829-420a-8f3d-ed1eabacd2ed tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:26.108044 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-6d90eca6-b829-420a-8f3d-ed1eabacd2ed tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:26.115990 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-6d90eca6-b829-420a-8f3d-ed1eabacd2ed tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1266 microversion: 2.1 time: 0.152178 Nov 24 16:22:26.116557 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 662/1299] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:25 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:27.133081 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-16e6f151-5e06-48e3-bc7a-4fe4c14d1e9e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:27.133775 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-16e6f151-5e06-48e3-bc7a-4fe4c14d1e9e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:27.139884 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-16e6f151-5e06-48e3-bc7a-4fe4c14d1e9e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:27.140337 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-16e6f151-5e06-48e3-bc7a-4fe4c14d1e9e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:27.141135 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-16e6f151-5e06-48e3-bc7a-4fe4c14d1e9e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:27.141570 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-16e6f151-5e06-48e3-bc7a-4fe4c14d1e9e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:27.275270 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-16e6f151-5e06-48e3-bc7a-4fe4c14d1e9e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:27.282387 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-16e6f151-5e06-48e3-bc7a-4fe4c14d1e9e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1266 microversion: 2.1 time: 0.154086 Nov 24 16:22:27.282942 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 638/1300] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:27 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:28.299466 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-19fd8a14-0e62-45fb-abaf-b0ff3cef0330 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:28.300086 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-19fd8a14-0e62-45fb-abaf-b0ff3cef0330 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:28.307045 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-19fd8a14-0e62-45fb-abaf-b0ff3cef0330 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:28.307494 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-19fd8a14-0e62-45fb-abaf-b0ff3cef0330 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:28.308275 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-19fd8a14-0e62-45fb-abaf-b0ff3cef0330 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:28.308712 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-19fd8a14-0e62-45fb-abaf-b0ff3cef0330 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:28.449547 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-19fd8a14-0e62-45fb-abaf-b0ff3cef0330 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:28.456774 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-19fd8a14-0e62-45fb-abaf-b0ff3cef0330 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1266 microversion: 2.1 time: 0.161056 Nov 24 16:22:28.457432 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 663/1301] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:28 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:29.474408 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-23fc992c-f9a6-49f9-814d-ebd2622fa908 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:29.474972 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-23fc992c-f9a6-49f9-814d-ebd2622fa908 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:29.481341 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23fc992c-f9a6-49f9-814d-ebd2622fa908 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:29.481837 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23fc992c-f9a6-49f9-814d-ebd2622fa908 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:29.482582 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23fc992c-f9a6-49f9-814d-ebd2622fa908 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:29.483025 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-23fc992c-f9a6-49f9-814d-ebd2622fa908 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:29.620227 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-23fc992c-f9a6-49f9-814d-ebd2622fa908 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:29.627862 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-23fc992c-f9a6-49f9-814d-ebd2622fa908 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1266 microversion: 2.1 time: 0.158029 Nov 24 16:22:29.628426 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 639/1302] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:29 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:30.645660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-0e784271-5281-472c-affe-b0d217144696 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:30.646366 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-0e784271-5281-472c-affe-b0d217144696 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:30.652672 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0e784271-5281-472c-affe-b0d217144696 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:30.653150 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0e784271-5281-472c-affe-b0d217144696 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:30.653933 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0e784271-5281-472c-affe-b0d217144696 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:30.654369 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-0e784271-5281-472c-affe-b0d217144696 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:30.789470 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-0e784271-5281-472c-affe-b0d217144696 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:30.796911 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-0e784271-5281-472c-affe-b0d217144696 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1266 microversion: 2.1 time: 0.155692 Nov 24 16:22:30.797516 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 664/1303] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:30 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:31.813057 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-1412267f-3b7a-4db6-8974-af4ce4409329 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:31.814409 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-1412267f-3b7a-4db6-8974-af4ce4409329 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:31.820791 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1412267f-3b7a-4db6-8974-af4ce4409329 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:31.821271 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1412267f-3b7a-4db6-8974-af4ce4409329 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:31.822053 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1412267f-3b7a-4db6-8974-af4ce4409329 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:31.822485 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-1412267f-3b7a-4db6-8974-af4ce4409329 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:31.955910 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-1412267f-3b7a-4db6-8974-af4ce4409329 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:31.963827 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-1412267f-3b7a-4db6-8974-af4ce4409329 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1266 microversion: 2.1 time: 0.154476 Nov 24 16:22:31.964396 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 640/1304] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:31 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:32.981145 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ecd3e211-dcc5-4188-a399-080a3c6b3582 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:32.981745 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ecd3e211-dcc5-4188-a399-080a3c6b3582 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:32.988095 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ecd3e211-dcc5-4188-a399-080a3c6b3582 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:32.988600 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ecd3e211-dcc5-4188-a399-080a3c6b3582 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:32.989425 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ecd3e211-dcc5-4188-a399-080a3c6b3582 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:32.989885 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ecd3e211-dcc5-4188-a399-080a3c6b3582 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:33.121787 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-ecd3e211-dcc5-4188-a399-080a3c6b3582 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:33.129777 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ecd3e211-dcc5-4188-a399-080a3c6b3582 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1266 microversion: 2.1 time: 0.151933 Nov 24 16:22:33.130359 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 665/1305] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:32 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:34.147308 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f7789811-651e-4eae-be83-0b8a5a8efb2a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:34.147948 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f7789811-651e-4eae-be83-0b8a5a8efb2a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:34.154490 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f7789811-651e-4eae-be83-0b8a5a8efb2a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:34.154941 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f7789811-651e-4eae-be83-0b8a5a8efb2a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:34.155731 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f7789811-651e-4eae-be83-0b8a5a8efb2a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:34.156168 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f7789811-651e-4eae-be83-0b8a5a8efb2a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:34.295545 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-f7789811-651e-4eae-be83-0b8a5a8efb2a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:34.303491 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f7789811-651e-4eae-be83-0b8a5a8efb2a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1266 microversion: 2.1 time: 0.160656 Nov 24 16:22:34.304077 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 641/1306] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:34 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:35.320282 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-9992e9af-794b-4055-8963-8d52adcbff5c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:35.320870 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-9992e9af-794b-4055-8963-8d52adcbff5c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:35.327139 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9992e9af-794b-4055-8963-8d52adcbff5c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:35.327583 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9992e9af-794b-4055-8963-8d52adcbff5c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:35.328348 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9992e9af-794b-4055-8963-8d52adcbff5c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:35.328773 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-9992e9af-794b-4055-8963-8d52adcbff5c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:35.466739 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-9992e9af-794b-4055-8963-8d52adcbff5c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:35.475122 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-9992e9af-794b-4055-8963-8d52adcbff5c tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1266 microversion: 2.1 time: 0.158750 Nov 24 16:22:35.475691 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 666/1307] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:35 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:36.170835 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-e2dbad36-4586-42d8-a0cf-7b5f2e2a2c7d req-d102805a-15f9-4a17-b121-d67df0cb972b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "name": "network-vif-plugged", "status": "completed", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:22:36.172345 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:22:36.172345 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:22:36.180559 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-e2dbad36-4586-42d8-a0cf-7b5f2e2a2c7d req-d102805a-15f9-4a17-b121-d67df0cb972b service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:36.181006 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-e2dbad36-4586-42d8-a0cf-7b5f2e2a2c7d req-d102805a-15f9-4a17-b121-d67df0cb972b service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:36.193372 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-e2dbad36-4586-42d8-a0cf-7b5f2e2a2c7d req-d102805a-15f9-4a17-b121-d67df0cb972b service nova] Creating event network-vif-plugged:5fb88ff0-bd58-4f17-b36d-7ceece933b04 for instance e5d37abd-923b-419b-805e-303baf82ea67 on hv-cinder-81899 Nov 24 16:22:36.198604 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-e2dbad36-4586-42d8-a0cf-7b5f2e2a2c7d req-d102805a-15f9-4a17-b121-d67df0cb972b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031377 Nov 24 16:22:36.199209 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 642/1308] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:22:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:22:36.491911 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-4ef697f9-4212-49f1-b75e-c1f636d0c192 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:36.492504 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-4ef697f9-4212-49f1-b75e-c1f636d0c192 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:36.498910 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4ef697f9-4212-49f1-b75e-c1f636d0c192 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:36.499361 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4ef697f9-4212-49f1-b75e-c1f636d0c192 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:36.500150 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4ef697f9-4212-49f1-b75e-c1f636d0c192 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:36.500879 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-4ef697f9-4212-49f1-b75e-c1f636d0c192 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:36.638169 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-4ef697f9-4212-49f1-b75e-c1f636d0c192 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:36.646086 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-4ef697f9-4212-49f1-b75e-c1f636d0c192 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1266 microversion: 2.1 time: 0.158126 Nov 24 16:22:36.646660 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 667/1309] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:36 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:37.663050 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-ac2b1ae8-c960-4ef8-b4fc-77966ed13720 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:37.663775 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-ac2b1ae8-c960-4ef8-b4fc-77966ed13720 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:37.670029 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac2b1ae8-c960-4ef8-b4fc-77966ed13720 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:37.670484 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac2b1ae8-c960-4ef8-b4fc-77966ed13720 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:37.671269 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac2b1ae8-c960-4ef8-b4fc-77966ed13720 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:37.671707 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-ac2b1ae8-c960-4ef8-b4fc-77966ed13720 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:37.811090 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-ac2b1ae8-c960-4ef8-b4fc-77966ed13720 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:37.818875 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-ac2b1ae8-c960-4ef8-b4fc-77966ed13720 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1266 microversion: 2.1 time: 0.160387 Nov 24 16:22:37.819450 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 643/1310] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:37 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:38.835906 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-d25648fa-cbce-47e7-b645-ca39edbe109d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:38.836546 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-d25648fa-cbce-47e7-b645-ca39edbe109d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:38.844881 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d25648fa-cbce-47e7-b645-ca39edbe109d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:38.845347 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d25648fa-cbce-47e7-b645-ca39edbe109d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:38.846124 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d25648fa-cbce-47e7-b645-ca39edbe109d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:38.846549 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-d25648fa-cbce-47e7-b645-ca39edbe109d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:38.981420 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-d25648fa-cbce-47e7-b645-ca39edbe109d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:38.989572 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-d25648fa-cbce-47e7-b645-ca39edbe109d tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1454 microversion: 2.1 time: 0.157459 Nov 24 16:22:38.990175 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 668/1311] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:38 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:39.005600 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a6c125d4-0736-45da-a734-9188baa23753 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:22:39.006204 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a6c125d4-0736-45da-a734-9188baa23753 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:22:39.012481 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a6c125d4-0736-45da-a734-9188baa23753 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:39.012929 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a6c125d4-0736-45da-a734-9188baa23753 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:39.013750 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a6c125d4-0736-45da-a734-9188baa23753 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:39.014259 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a6c125d4-0736-45da-a734-9188baa23753 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:39.146717 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a6c125d4-0736-45da-a734-9188baa23753 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:22:39.154030 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a6c125d4-0736-45da-a734-9188baa23753 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1454 microversion: 2.1 time: 0.152237 Nov 24 16:22:39.154596 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 644/1312] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:22:39 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:22:40.855256 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-15e36acc-e1bc-4525-862e-dfb1a9198efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:22:40.856795 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:22:40.856795 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:22:40.863817 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-15e36acc-e1bc-4525-862e-dfb1a9198efe service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:22:40.864261 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-15e36acc-e1bc-4525-862e-dfb1a9198efe service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:22:40.875113 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-15e36acc-e1bc-4525-862e-dfb1a9198efe service nova] Creating event network-changed:5fb88ff0-bd58-4f17-b36d-7ceece933b04 for instance e5d37abd-923b-419b-805e-303baf82ea67 on hv-cinder-81899 Nov 24 16:22:40.880456 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-d81677d8-4155-4d53-a3cd-20c7c07f70b8 req-15e36acc-e1bc-4525-862e-dfb1a9198efe service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028785 Nov 24 16:22:40.881135 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 669/1313] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:22:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:23:35.748949 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:23:35.749657 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: Wed Nov 24 16:23:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:23:55.328680 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-7a818d28-be13-495a-9278-b29407d7efb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:23:55.330157 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:23:55.330157 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:23:55.335744 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-71402d15-ff23-4d51-b6eb-ddaa45c781fd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:23:55.336229 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-71402d15-ff23-4d51-b6eb-ddaa45c781fd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:23:55.338574 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-7a818d28-be13-495a-9278-b29407d7efb1 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:23:55.340314 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-7a818d28-be13-495a-9278-b29407d7efb1 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:23:55.342334 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-71402d15-ff23-4d51-b6eb-ddaa45c781fd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:23:55.342773 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-71402d15-ff23-4d51-b6eb-ddaa45c781fd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:23:55.343759 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-71402d15-ff23-4d51-b6eb-ddaa45c781fd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:23:55.344194 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-71402d15-ff23-4d51-b6eb-ddaa45c781fd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:23:55.353658 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-7a818d28-be13-495a-9278-b29407d7efb1 service nova] Creating event network-changed:3762c609-4d3f-4e0f-a146-c0077e3c9f5c for instance 47ed20e5-f963-4489-aa73-4d9e4306db2b on hv-cinder-81899 Nov 24 16:23:55.358879 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-6ad57e01-2e04-4222-a5a5-f0eaa1b6a1d0 req-7a818d28-be13-495a-9278-b29407d7efb1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035363 Nov 24 16:23:55.359480 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 670/1314] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:23:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:23:55.370175 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-71402d15-ff23-4d51-b6eb-ddaa45c781fd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Going to try to terminate instance {{(pid=116304) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:23:55.460365 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-71402d15-ff23-4d51-b6eb-ddaa45c781fd tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "DELETE /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 204 len: 0 microversion: 2.1 time: 0.139721 Nov 24 16:23:55.464459 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 645/1315] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:23:55 2021] DELETE /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:23:55.471033 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ca0ced8b-4cd1-4efa-a2ae-57c0c952534d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:23:55.472105 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ca0ced8b-4cd1-4efa-a2ae-57c0c952534d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:23:55.479971 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ca0ced8b-4cd1-4efa-a2ae-57c0c952534d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:23:55.480623 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ca0ced8b-4cd1-4efa-a2ae-57c0c952534d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:23:55.482486 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ca0ced8b-4cd1-4efa-a2ae-57c0c952534d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:23:55.483050 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ca0ced8b-4cd1-4efa-a2ae-57c0c952534d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:23:55.626540 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-ca0ced8b-4cd1-4efa-a2ae-57c0c952534d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:23:55.634368 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ca0ced8b-4cd1-4efa-a2ae-57c0c952534d tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1569 microversion: 2.1 time: 0.168229 Nov 24 16:23:55.644320 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 671/1316] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:23:55 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:23:56.652757 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-d778227a-dafd-4896-a0ae-42d943fd670f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:23:56.653477 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-d778227a-dafd-4896-a0ae-42d943fd670f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:23:56.659893 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d778227a-dafd-4896-a0ae-42d943fd670f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:23:56.660286 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d778227a-dafd-4896-a0ae-42d943fd670f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:23:56.661728 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d778227a-dafd-4896-a0ae-42d943fd670f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:23:56.662173 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-d778227a-dafd-4896-a0ae-42d943fd670f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:23:56.801266 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-d778227a-dafd-4896-a0ae-42d943fd670f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:23:56.808832 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-d778227a-dafd-4896-a0ae-42d943fd670f tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1450 microversion: 2.1 time: 0.160218 Nov 24 16:23:56.809474 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 646/1317] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:23:56 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:23:57.606764 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [req-c987d06d-9123-4d68-99fe-b97058907329 req-8ccd46cd-1c2b-4535-928a-b05911510557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ed20e5-f963-4489-aa73-4d9e4306db2b", "name": "network-vif-deleted", "tag": "3762c609-4d3f-4e0f-a146-c0077e3c9f5c"}]} {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:23:57.608326 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:23:57.608326 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: warnings.warn(msg) Nov 24 16:23:57.616936 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-c987d06d-9123-4d68-99fe-b97058907329 req-8ccd46cd-1c2b-4535-928a-b05911510557 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:23:57.617411 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [req-c987d06d-9123-4d68-99fe-b97058907329 req-8ccd46cd-1c2b-4535-928a-b05911510557 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:23:57.629402 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.compute.server_external_events [req-c987d06d-9123-4d68-99fe-b97058907329 req-8ccd46cd-1c2b-4535-928a-b05911510557 service nova] Creating event network-vif-deleted:3762c609-4d3f-4e0f-a146-c0077e3c9f5c for instance 47ed20e5-f963-4489-aa73-4d9e4306db2b on hv-cinder-81899 Nov 24 16:23:57.635415 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [req-c987d06d-9123-4d68-99fe-b97058907329 req-8ccd46cd-1c2b-4535-928a-b05911510557 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032269 Nov 24 16:23:57.636011 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 672/1318] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:23:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 16:23:57.826090 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-dbfc6394-8e6c-4c95-a081-c085d463ac06 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:23:57.826643 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-dbfc6394-8e6c-4c95-a081-c085d463ac06 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:23:57.833139 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbfc6394-8e6c-4c95-a081-c085d463ac06 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:23:57.833777 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbfc6394-8e6c-4c95-a081-c085d463ac06 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:23:57.834565 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbfc6394-8e6c-4c95-a081-c085d463ac06 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:23:57.835001 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-dbfc6394-8e6c-4c95-a081-c085d463ac06 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:23:57.901543 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-dbfc6394-8e6c-4c95-a081-c085d463ac06 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354362f62ea746ad94901a4fe5b65217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05ec47caaa4b86ba407fd376f503c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:23:57.909320 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-dbfc6394-8e6c-4c95-a081-c085d463ac06 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 200 len: 1219 microversion: 2.1 time: 0.086851 Nov 24 16:23:57.909908 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 647/1319] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:23:57 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:23:58.928957 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f5c97cbd-b6e8-4eb9-ba46-5966a930f4c4 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:23:58.929689 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-f5c97cbd-b6e8-4eb9-ba46-5966a930f4c4 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] [instance: 47ed20e5-f963-4489-aa73-4d9e4306db2b] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:23:58.935824 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f5c97cbd-b6e8-4eb9-ba46-5966a930f4c4 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:23:58.936275 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f5c97cbd-b6e8-4eb9-ba46-5966a930f4c4 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:23:58.937073 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f5c97cbd-b6e8-4eb9-ba46-5966a930f4c4 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:23:58.937515 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-f5c97cbd-b6e8-4eb9-ba46-5966a930f4c4 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:23:58.951986 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-f5c97cbd-b6e8-4eb9-ba46-5966a930f4c4 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] HTTP exception thrown: Instance 47ed20e5-f963-4489-aa73-4d9e4306db2b could not be found. Nov 24 16:23:58.952570 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-f5c97cbd-b6e8-4eb9-ba46-5966a930f4c4 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Returning 404 to user: Instance 47ed20e5-f963-4489-aa73-4d9e4306db2b could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:23:58.953410 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-f5c97cbd-b6e8-4eb9-ba46-5966a930f4c4 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b" status: 404 len: 111 microversion: 2.1 time: 0.029153 Nov 24 16:23:58.953940 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 673/1320] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:23:58 2021] GET /compute/v2.1/servers/47ed20e5-f963-4489-aa73-4d9e4306db2b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:23:59.109518 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-908bed16-41b3-4f31-9b5d-3e13c2b4db45 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] Calling method '.version_select at 0x7f361a98d5e0>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:23:59.135601 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-908bed16-41b3-4f31-9b5d-3e13c2b4db45 tempest-TestShelveInstance-1071222991 tempest-TestShelveInstance-1071222991-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2093989883" status: 202 len: 0 microversion: 2.1 time: 0.029624 Nov 24 16:23:59.136183 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 648/1321] 10.222.0.72 () {58 vars in 1253 bytes} [Wed Nov 24 16:23:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2093989883 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:24:30.770339 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-85989b44-93c5-42a3-aed5-dbe081dba5a6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:24:30.771068 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-85989b44-93c5-42a3-aed5-dbe081dba5a6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:24:30.773586 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-4f337be6-ad86-455e-a7dc-4da9764d06af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:24:30.775209 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:24:30.775209 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:24:30.776875 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-85989b44-93c5-42a3-aed5-dbe081dba5a6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:30.777371 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-85989b44-93c5-42a3-aed5-dbe081dba5a6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:30.778155 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-85989b44-93c5-42a3-aed5-dbe081dba5a6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:30.778582 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-85989b44-93c5-42a3-aed5-dbe081dba5a6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:30.786293 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-4f337be6-ad86-455e-a7dc-4da9764d06af service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:30.787045 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-4f337be6-ad86-455e-a7dc-4da9764d06af service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:30.798269 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-4f337be6-ad86-455e-a7dc-4da9764d06af service nova] Creating event network-changed:5fb88ff0-bd58-4f17-b36d-7ceece933b04 for instance e5d37abd-923b-419b-805e-303baf82ea67 on hv-cinder-81899 Nov 24 16:24:30.803957 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-85989b44-93c5-42a3-aed5-dbe081dba5a6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Going to try to terminate instance {{(pid=116303) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:24:30.804692 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-b1cafb11-f8f6-4bf7-a6aa-58c61d965dd2 req-4f337be6-ad86-455e-a7dc-4da9764d06af service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036024 Nov 24 16:24:30.805678 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 649/1322] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:24:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:24:30.889828 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-85989b44-93c5-42a3-aed5-dbe081dba5a6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 204 len: 0 microversion: 2.1 time: 0.123516 Nov 24 16:24:30.890799 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 674/1323] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:24:30 2021] DELETE /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:24:30.899203 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a105efcc-96b9-45b6-8426-4107eaee323a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:24:30.899904 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a105efcc-96b9-45b6-8426-4107eaee323a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:24:30.906307 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a105efcc-96b9-45b6-8426-4107eaee323a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:30.906765 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a105efcc-96b9-45b6-8426-4107eaee323a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:30.907562 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a105efcc-96b9-45b6-8426-4107eaee323a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:30.908195 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a105efcc-96b9-45b6-8426-4107eaee323a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:31.128036 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-a105efcc-96b9-45b6-8426-4107eaee323a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:24:31.136998 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a105efcc-96b9-45b6-8426-4107eaee323a tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1578 microversion: 2.1 time: 0.241998 Nov 24 16:24:31.137694 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 650/1324] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:24:30 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1578 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:24:32.155658 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-ff1d7c82-bba8-4cfa-aab5-50b70d936728 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:24:32.156262 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-ff1d7c82-bba8-4cfa-aab5-50b70d936728 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:24:32.166579 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ff1d7c82-bba8-4cfa-aab5-50b70d936728 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:32.167023 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ff1d7c82-bba8-4cfa-aab5-50b70d936728 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:32.167975 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ff1d7c82-bba8-4cfa-aab5-50b70d936728 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:32.168475 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-ff1d7c82-bba8-4cfa-aab5-50b70d936728 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:32.305580 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-ff1d7c82-bba8-4cfa-aab5-50b70d936728 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:24:32.312784 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-ff1d7c82-bba8-4cfa-aab5-50b70d936728 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1460 microversion: 2.1 time: 0.161278 Nov 24 16:24:32.313392 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 675/1325] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:24:32 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1460 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:24:33.121430 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-7b3bdd3a-e6a1-455a-a2e3-bc380317e854 req-7ba72517-27ad-4138-bab4-3a3137096b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d37abd-923b-419b-805e-303baf82ea67", "name": "network-vif-deleted", "tag": "5fb88ff0-bd58-4f17-b36d-7ceece933b04"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:24:33.123210 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:24:33.123210 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:24:33.133794 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-7b3bdd3a-e6a1-455a-a2e3-bc380317e854 req-7ba72517-27ad-4138-bab4-3a3137096b42 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:33.134409 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-7b3bdd3a-e6a1-455a-a2e3-bc380317e854 req-7ba72517-27ad-4138-bab4-3a3137096b42 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:33.149776 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-7b3bdd3a-e6a1-455a-a2e3-bc380317e854 req-7ba72517-27ad-4138-bab4-3a3137096b42 service nova] Creating event network-vif-deleted:5fb88ff0-bd58-4f17-b36d-7ceece933b04 for instance e5d37abd-923b-419b-805e-303baf82ea67 on hv-cinder-81899 Nov 24 16:24:33.156104 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-7b3bdd3a-e6a1-455a-a2e3-bc380317e854 req-7ba72517-27ad-4138-bab4-3a3137096b42 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039152 Nov 24 16:24:33.156701 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 651/1326] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:24:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:24:33.329832 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-60266111-a67e-449a-8899-273e3c861bd0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:24:33.330401 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-60266111-a67e-449a-8899-273e3c861bd0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:24:33.336734 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-60266111-a67e-449a-8899-273e3c861bd0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:33.337217 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-60266111-a67e-449a-8899-273e3c861bd0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:33.337988 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-60266111-a67e-449a-8899-273e3c861bd0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:33.338418 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-60266111-a67e-449a-8899-273e3c861bd0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:33.407256 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-60266111-a67e-449a-8899-273e3c861bd0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:24:33.415129 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-60266111-a67e-449a-8899-273e3c861bd0 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 200 len: 1226 microversion: 2.1 time: 0.089131 Nov 24 16:24:33.415711 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 676/1327] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:24:33 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:24:34.432641 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a24fe3bd-b101-4c49-961e-cf2c3da1c0d6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:24:34.433370 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-a24fe3bd-b101-4c49-961e-cf2c3da1c0d6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: e5d37abd-923b-419b-805e-303baf82ea67] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:24:34.439885 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a24fe3bd-b101-4c49-961e-cf2c3da1c0d6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:34.440342 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a24fe3bd-b101-4c49-961e-cf2c3da1c0d6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:34.441780 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a24fe3bd-b101-4c49-961e-cf2c3da1c0d6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:34.442393 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-a24fe3bd-b101-4c49-961e-cf2c3da1c0d6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:34.455514 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-a24fe3bd-b101-4c49-961e-cf2c3da1c0d6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] HTTP exception thrown: Instance e5d37abd-923b-419b-805e-303baf82ea67 could not be found. Nov 24 16:24:34.456112 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-a24fe3bd-b101-4c49-961e-cf2c3da1c0d6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Returning 404 to user: Instance e5d37abd-923b-419b-805e-303baf82ea67 could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:24:34.457554 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-a24fe3bd-b101-4c49-961e-cf2c3da1c0d6 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67" status: 404 len: 111 microversion: 2.1 time: 0.028427 Nov 24 16:24:34.458109 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 652/1328] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:24:34 2021] GET /compute/v2.1/servers/e5d37abd-923b-419b-805e-303baf82ea67 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:24:37.491963 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-c1a92d78-ee0a-450b-925c-a821d8951ead tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:24:37.492506 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c1a92d78-ee0a-450b-925c-a821d8951ead tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:24:37.495205 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-1aba91c5-4e34-4755-b5c3-6090ffe5dd04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:24:37.496847 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:24:37.496847 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:24:37.499687 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c1a92d78-ee0a-450b-925c-a821d8951ead tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:37.500137 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c1a92d78-ee0a-450b-925c-a821d8951ead tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:37.501231 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c1a92d78-ee0a-450b-925c-a821d8951ead tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:37.501666 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-c1a92d78-ee0a-450b-925c-a821d8951ead tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:37.506008 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-1aba91c5-4e34-4755-b5c3-6090ffe5dd04 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:37.506534 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-1aba91c5-4e34-4755-b5c3-6090ffe5dd04 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:37.517586 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-1aba91c5-4e34-4755-b5c3-6090ffe5dd04 service nova] Creating event network-changed:f28496a8-b616-467e-a96a-64cd302d5c4e for instance 010bad81-4c64-4106-8ff5-ba171e3352ff on hv-cinder-81899 Nov 24 16:24:37.523736 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-a10b3ff7-1738-47ec-bceb-65fc1070ba68 req-1aba91c5-4e34-4755-b5c3-6090ffe5dd04 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032466 Nov 24 16:24:37.525019 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 653/1329] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:24:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:24:37.531017 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-c1a92d78-ee0a-450b-925c-a821d8951ead tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Going to try to terminate instance {{(pid=116303) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 16:24:37.624003 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-c1a92d78-ee0a-450b-925c-a821d8951ead tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 204 len: 0 microversion: 2.1 time: 0.135653 Nov 24 16:24:37.628187 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 677/1330] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:24:37 2021] DELETE /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 16:24:37.634635 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-5ba1fecb-ff81-463d-9656-31efa0bbc8d2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:24:37.635583 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-5ba1fecb-ff81-463d-9656-31efa0bbc8d2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:24:37.643482 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ba1fecb-ff81-463d-9656-31efa0bbc8d2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:37.644816 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ba1fecb-ff81-463d-9656-31efa0bbc8d2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:37.646052 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ba1fecb-ff81-463d-9656-31efa0bbc8d2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:37.646778 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-5ba1fecb-ff81-463d-9656-31efa0bbc8d2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:37.864365 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.policy [None req-5ba1fecb-ff81-463d-9656-31efa0bbc8d2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116304) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:24:37.871830 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-5ba1fecb-ff81-463d-9656-31efa0bbc8d2 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1579 microversion: 2.1 time: 0.241552 Nov 24 16:24:37.872404 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 654/1331] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:24:37 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1579 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:24:38.890312 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-5c3a14ec-2f8c-4b2a-89e2-1b0da30e5d08 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:24:38.890928 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-5c3a14ec-2f8c-4b2a-89e2-1b0da30e5d08 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:24:38.898074 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5c3a14ec-2f8c-4b2a-89e2-1b0da30e5d08 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:38.898545 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5c3a14ec-2f8c-4b2a-89e2-1b0da30e5d08 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:38.899322 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5c3a14ec-2f8c-4b2a-89e2-1b0da30e5d08 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:38.899761 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-5c3a14ec-2f8c-4b2a-89e2-1b0da30e5d08 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:39.031890 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-5c3a14ec-2f8c-4b2a-89e2-1b0da30e5d08 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:24:39.039274 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-5c3a14ec-2f8c-4b2a-89e2-1b0da30e5d08 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1460 microversion: 2.1 time: 0.153082 Nov 24 16:24:39.039844 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 678/1332] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:24:38 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1460 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:24:39.828015 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [req-413d3eb6-c304-41a3-a190-a91b0fb30032 req-25f3fb02-6da1-4d42-a933-9455aa2d1ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010bad81-4c64-4106-8ff5-ba171e3352ff", "name": "network-vif-deleted", "tag": "f28496a8-b616-467e-a96a-64cd302d5c4e"}]} {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 16:24:39.829723 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 16:24:39.829723 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: warnings.warn(msg) Nov 24 16:24:39.838583 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-413d3eb6-c304-41a3-a190-a91b0fb30032 req-25f3fb02-6da1-4d42-a933-9455aa2d1ab0 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:39.839111 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [req-413d3eb6-c304-41a3-a190-a91b0fb30032 req-25f3fb02-6da1-4d42-a933-9455aa2d1ab0 service nova] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:39.852364 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.compute.server_external_events [req-413d3eb6-c304-41a3-a190-a91b0fb30032 req-25f3fb02-6da1-4d42-a933-9455aa2d1ab0 service nova] Creating event network-vif-deleted:f28496a8-b616-467e-a96a-64cd302d5c4e for instance 010bad81-4c64-4106-8ff5-ba171e3352ff on hv-cinder-81899 Nov 24 16:24:39.857413 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [req-413d3eb6-c304-41a3-a190-a91b0fb30032 req-25f3fb02-6da1-4d42-a933-9455aa2d1ab0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033149 Nov 24 16:24:39.858247 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 655/1333] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Nov 24 16:24:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 16:24:40.056044 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-14c5596b-f804-4f93-86ab-da9a58e7e80e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:24:40.056618 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-14c5596b-f804-4f93-86ab-da9a58e7e80e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:24:40.062809 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-14c5596b-f804-4f93-86ab-da9a58e7e80e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:40.063271 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-14c5596b-f804-4f93-86ab-da9a58e7e80e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:40.064204 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-14c5596b-f804-4f93-86ab-da9a58e7e80e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:40.064704 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-14c5596b-f804-4f93-86ab-da9a58e7e80e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:40.099238 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-14c5596b-f804-4f93-86ab-da9a58e7e80e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:40.099691 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-14c5596b-f804-4f93-86ab-da9a58e7e80e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:40.100149 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.objects.instance [None req-14c5596b-f804-4f93-86ab-da9a58e7e80e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lazy-loading 'fault' on Instance uuid 010bad81-4c64-4106-8ff5-ba171e3352ff {{(pid=116303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 16:24:40.144019 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.policy [None req-14c5596b-f804-4f93-86ab-da9a58e7e80e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1181f7a15e6d4732865fe02f985bf189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2d50102bf491986834edf07a6a868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116303) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 16:24:40.151939 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-14c5596b-f804-4f93-86ab-da9a58e7e80e tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 200 len: 1231 microversion: 2.1 time: 0.099555 Nov 24 16:24:40.152559 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 679/1334] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:24:40 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 16:24:41.170022 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-147ed73a-eca1-4aad-9caf-e9fc0688b585 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:24:41.170708 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-147ed73a-eca1-4aad-9caf-e9fc0688b585 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 010bad81-4c64-4106-8ff5-ba171e3352ff] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:24:41.177459 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-147ed73a-eca1-4aad-9caf-e9fc0688b585 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:41.177911 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-147ed73a-eca1-4aad-9caf-e9fc0688b585 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:41.178682 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-147ed73a-eca1-4aad-9caf-e9fc0688b585 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:41.179216 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-147ed73a-eca1-4aad-9caf-e9fc0688b585 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:41.192304 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-147ed73a-eca1-4aad-9caf-e9fc0688b585 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] HTTP exception thrown: Instance 010bad81-4c64-4106-8ff5-ba171e3352ff could not be found. Nov 24 16:24:41.192879 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-147ed73a-eca1-4aad-9caf-e9fc0688b585 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Returning 404 to user: Instance 010bad81-4c64-4106-8ff5-ba171e3352ff could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:24:41.193748 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-147ed73a-eca1-4aad-9caf-e9fc0688b585 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff" status: 404 len: 111 microversion: 2.1 time: 0.028188 Nov 24 16:24:41.194275 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 656/1335] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:24:41 2021] GET /compute/v2.1/servers/010bad81-4c64-4106-8ff5-ba171e3352ff => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:24:41.870963 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7cb6e885-4f6b-450e-a959-ee33fc580569 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:24:41.871471 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.compute.api [None req-7cb6e885-4f6b-450e-a959-ee33fc580569 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116303) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:24:41.877957 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7cb6e885-4f6b-450e-a959-ee33fc580569 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:41.879156 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7cb6e885-4f6b-450e-a959-ee33fc580569 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:41.880082 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7cb6e885-4f6b-450e-a959-ee33fc580569 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:41.880545 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG oslo_concurrency.lockutils [None req-7cb6e885-4f6b-450e-a959-ee33fc580569 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:41.893774 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.wsgi [None req-7cb6e885-4f6b-450e-a959-ee33fc580569 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] HTTP exception thrown: Instance 2843917b-11a2-42d7-bf56-f60e26980b1f could not be found. Nov 24 16:24:41.894791 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-7cb6e885-4f6b-450e-a959-ee33fc580569 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Returning 404 to user: Instance 2843917b-11a2-42d7-bf56-f60e26980b1f could not be found. {{(pid=116303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:24:41.895608 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-7cb6e885-4f6b-450e-a959-ee33fc580569 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 404 len: 111 microversion: 2.1 time: 0.028373 Nov 24 16:24:41.896216 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 680/1336] 10.222.0.72 () {58 vars in 1238 bytes} [Wed Nov 24 16:24:41 2021] DELETE /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:24:41.904085 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f902dfb8-b646-49a2-b25b-ccfc15157943 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '>' {{(pid=116304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:24:41.904697 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.compute.api [None req-f902dfb8-b646-49a2-b25b-ccfc15157943 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] [instance: 2843917b-11a2-42d7-bf56-f60e26980b1f] Fetching instance by UUID {{(pid=116304) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 16:24:41.911375 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f902dfb8-b646-49a2-b25b-ccfc15157943 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:41.911825 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f902dfb8-b646-49a2-b25b-ccfc15157943 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:41.912608 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f902dfb8-b646-49a2-b25b-ccfc15157943 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 16:24:41.913064 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG oslo_concurrency.lockutils [None req-f902dfb8-b646-49a2-b25b-ccfc15157943 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Lock "e04849b7-0f13-4ee3-8a70-886919bfc8c5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 16:24:41.926810 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.wsgi [None req-f902dfb8-b646-49a2-b25b-ccfc15157943 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] HTTP exception thrown: Instance 2843917b-11a2-42d7-bf56-f60e26980b1f could not be found. Nov 24 16:24:41.927399 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: DEBUG nova.api.openstack.wsgi [None req-f902dfb8-b646-49a2-b25b-ccfc15157943 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Returning 404 to user: Instance 2843917b-11a2-42d7-bf56-f60e26980b1f could not be found. {{(pid=116304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 16:24:41.933401 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO nova.api.openstack.requestlog [None req-f902dfb8-b646-49a2-b25b-ccfc15157943 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f" status: 404 len: 111 microversion: 2.1 time: 0.027897 Nov 24 16:24:41.933939 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: [pid: 116304|app: 0|req: 657/1337] 10.222.0.72 () {58 vars in 1235 bytes} [Wed Nov 24 16:24:41 2021] GET /compute/v2.1/servers/2843917b-11a2-42d7-bf56-f60e26980b1f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 16:24:43.205995 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: DEBUG nova.api.openstack.wsgi [None req-32230af3-a7b5-42e8-8073-35c9d4658398 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] Calling method '.version_select at 0x7f361ac17820>' {{(pid=116303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 16:24:43.231075 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO nova.api.openstack.requestlog [None req-32230af3-a7b5-42e8-8073-35c9d4658398 tempest-TestVolumeBootPattern-782286816 tempest-TestVolumeBootPattern-782286816-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1778100134" status: 202 len: 0 microversion: 2.1 time: 0.028656 Nov 24 16:24:43.231938 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: [pid: 116303|app: 0|req: 681/1338] 10.222.0.72 () {58 vars in 1262 bytes} [Wed Nov 24 16:24:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1778100134 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 16:25:19.547545 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:25:19.548170 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: Wed Nov 24 16:25:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:25:20.396041 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:25:20.396598 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: Wed Nov 24 16:25:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:26:36.760289 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:26:36.760910 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: Wed Nov 24 16:26:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:27:51.454442 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:27:51.455171 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: Wed Nov 24 16:27:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:28:39.565667 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:28:39.566326 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: Wed Nov 24 16:28:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:28:40.413981 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:28:40.414557 dv-cinder-818994-2-iscsi devstack@n-api.service[116303]: Wed Nov 24 16:28:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 16:29:56.777381 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 16:29:56.777990 dv-cinder-818994-2-iscsi devstack@n-api.service[116304]: Wed Nov 24 16:29:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!